notificationworker stdout | 2022-11-28 06:52:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:52:42 UTC)" (scheduled at 2022-11-28 06:52:32.901291+00:00) notificationworker stdout | 2022-11-28 06:52:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:52:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:52:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:33 UTC)" (scheduled at 2022-11-28 06:52:33.026570+00:00) notificationworker stdout | 2022-11-28 06:52:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:52:33,332 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:33 UTC)" (scheduled at 2022-11-28 06:52:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:52:33,417 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:52:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:07 UTC)" (scheduled at 2022-11-28 06:52:37.716126+00:00) securityworker stdout | 2022-11-28 06:52:37,793 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:52:38,016 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:52:38,016 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:52:39,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:52:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:52:39,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:52:39,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:52:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:52:39,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 06:52:39,592 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.153 118 0.153) gunicorn-web stdout | 2022-11-28 06:52:39,628 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:52:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:52:52 UTC)" (scheduled at 2022-11-28 06:52:42.901291+00:00) notificationworker stdout | 2022-11-28 06:52:42,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:52:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:52:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:15 UTC)" (scheduled at 2022-11-28 06:52:45.911636+00:00) securityworker stdout | 2022-11-28 06:52:46,027 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:52:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:17 UTC)" (scheduled at 2022-11-28 06:52:47.016425+00:00) gcworker stdout | 2022-11-28 06:52:47,109 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:52:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:50 UTC)" (scheduled at 2022-11-28 06:52:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:52:50,245 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:52:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:51 UTC)" (scheduled at 2022-11-28 06:52:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:52:51,807 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:52:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:02 UTC)" (scheduled at 2022-11-28 06:52:52.901291+00:00) notificationworker stdout | 2022-11-28 06:52:52,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:52:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:23 UTC)" (scheduled at 2022-11-28 06:52:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:52:53,224 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:52:54,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:52:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:52:54,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:52:54,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:52:54,516 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 06:52:54,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:52:54,634 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.164 118 0.164) gunicorn-web stdout | 2022-11-28 06:52:54,637 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 06:52:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:56 UTC)" (scheduled at 2022-11-28 06:52:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:52:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:52:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:57 UTC)" (scheduled at 2022-11-28 06:52:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:52:57,610 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:53:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:53:02,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:12 UTC)" (scheduled at 2022-11-28 06:53:02.901291+00:00) notificationworker stdout | 2022-11-28 06:53:03,039 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:53:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:03 UTC)" (scheduled at 2022-11-28 06:53:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:53:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:53:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:06 UTC)" (scheduled at 2022-11-28 06:53:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:53:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:53:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:37 UTC)" (scheduled at 2022-11-28 06:53:07.716126+00:00) securityworker stdout | 2022-11-28 06:53:07,755 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:53:07,826 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:53:07,827 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:53:09,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:53:09,492 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:53:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:53:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:53:09,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:53:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) gunicorn-web stdout | 2022-11-28 06:53:09,624 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.158) gunicorn-web stdout | 2022-11-28 06:53:09,632 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:53:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:22 UTC)" (scheduled at 2022-11-28 06:53:12.901291+00:00) notificationworker stdout | 2022-11-28 06:53:12,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:53:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:15 UTC)" (scheduled at 2022-11-28 06:53:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:53:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:53:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:45 UTC)" (scheduled at 2022-11-28 06:53:15.911636+00:00) securityworker stdout | 2022-11-28 06:53:16,049 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:53:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:47 UTC)" (scheduled at 2022-11-28 06:53:17.016425+00:00) gcworker stdout | 2022-11-28 06:53:17,169 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:53:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:32 UTC)" (scheduled at 2022-11-28 06:53:22.901291+00:00) notificationworker stdout | 2022-11-28 06:53:22,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:53:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:53 UTC)" (scheduled at 2022-11-28 06:53:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:53:23,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:53:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:53:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:53:24,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:53:24,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:53:24,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:53:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:53:24,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:53:24,590 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) gunicorn-web stdout | 2022-11-28 06:53:24,613 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:53:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:42 UTC)" (scheduled at 2022-11-28 06:53:32.901291+00:00) notificationworker stdout | 2022-11-28 06:53:32,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:53:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:33 UTC)" (scheduled at 2022-11-28 06:53:33.026570+00:00) notificationworker stdout | 2022-11-28 06:53:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:53:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:33 UTC)" (scheduled at 2022-11-28 06:53:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:53:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:53:37,723 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:07 UTC)" (scheduled at 2022-11-28 06:53:37.716126+00:00) securityworker stdout | 2022-11-28 06:53:37,767 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:53:37,963 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:53:37,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:53:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:58:38 UTC)" (scheduled at 2022-11-28 06:53:38.420756+00:00) namespacegcworker stdout | 2022-11-28 06:53:38,551 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:58:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:53:39,499 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:53:39,508 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:53:39,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:53:39,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:53:39,518 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:53:39,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:53:39,574 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:53:39,574 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 06:53:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:52 UTC)" (scheduled at 2022-11-28 06:53:42.901291+00:00) notificationworker stdout | 2022-11-28 06:53:42,990 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:53:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:53:45,916 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:15 UTC)" (scheduled at 2022-11-28 06:53:45.911636+00:00) securityworker stdout | 2022-11-28 06:53:46,016 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:53:47,025 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:17 UTC)" (scheduled at 2022-11-28 06:53:47.016425+00:00) gcworker stdout | 2022-11-28 06:53:47,208 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:53:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:58:49 UTC)" (scheduled at 2022-11-28 06:53:49.405459+00:00) repositorygcworker stdout | 2022-11-28 06:53:49,516 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:58:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:53:50,133 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:50 UTC)" (scheduled at 2022-11-28 06:53:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:53:50,482 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:53:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:51 UTC)" (scheduled at 2022-11-28 06:53:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:53:51,815 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:53:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:02 UTC)" (scheduled at 2022-11-28 06:53:52.901291+00:00) notificationworker stdout | 2022-11-28 06:53:52,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:53:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:23 UTC)" (scheduled at 2022-11-28 06:53:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:53:53,240 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:53:54,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:53:54,494 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 06:53:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 06:53:54,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:53:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:53:54,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.123) gunicorn-web stdout | 2022-11-28 06:53:54,597 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:53:54,620 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.146) securityscanningnotificationworker stdout | 2022-11-28 06:53:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:56 UTC)" (scheduled at 2022-11-28 06:53:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:53:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:53:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:57 UTC)" (scheduled at 2022-11-28 06:53:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:53:57,700 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:54:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:54:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:12 UTC)" (scheduled at 2022-11-28 06:54:02.901291+00:00) notificationworker stdout | 2022-11-28 06:54:03,019 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:54:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:03 UTC)" (scheduled at 2022-11-28 06:54:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:54:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:54:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:06 UTC)" (scheduled at 2022-11-28 06:54:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:54:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:54:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:37 UTC)" (scheduled at 2022-11-28 06:54:07.716126+00:00) securityworker stdout | 2022-11-28 06:54:07,750 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:54:07,823 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:54:07,824 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:54:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:54:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 06:54:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:09,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:54:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:54:09,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 06:54:09,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) gunicorn-web stdout | 2022-11-28 06:54:09,588 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:54:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:22 UTC)" (scheduled at 2022-11-28 06:54:12.901291+00:00) notificationworker stdout | 2022-11-28 06:54:12,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:54:15,040 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:15 UTC)" (scheduled at 2022-11-28 06:54:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:54:15,040 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:54:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:45 UTC)" (scheduled at 2022-11-28 06:54:15.911636+00:00) securityworker stdout | 2022-11-28 06:54:15,995 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:54:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:47 UTC)" (scheduled at 2022-11-28 06:54:17.016425+00:00) gcworker stdout | 2022-11-28 06:54:17,090 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:54:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:32 UTC)" (scheduled at 2022-11-28 06:54:22.901291+00:00) notificationworker stdout | 2022-11-28 06:54:22,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:54:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:53 UTC)" (scheduled at 2022-11-28 06:54:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:54:23,202 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:54:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 06:54:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:54:24,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:54:24,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:54:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:54:24,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:54:24,585 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.174 118 0.174) gunicorn-web stdout | 2022-11-28 06:54:24,646 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:54:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:42 UTC)" (scheduled at 2022-11-28 06:54:32.901291+00:00) notificationworker stdout | 2022-11-28 06:54:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:33 UTC)" (scheduled at 2022-11-28 06:54:33.026570+00:00) notificationworker stdout | 2022-11-28 06:54:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:54:33,039 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:54:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:33 UTC)" (scheduled at 2022-11-28 06:54:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:54:33,389 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:54:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:07 UTC)" (scheduled at 2022-11-28 06:54:37.716126+00:00) securityworker stdout | 2022-11-28 06:54:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:54:37,892 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:54:37,893 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:54:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:59:38 UTC)" (scheduled at 2022-11-28 06:54:38.024004+00:00) notificationworker stdout | 2022-11-28 06:54:38,090 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 06:59:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:54:39,482 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:54:39,482 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:54:39,490 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:39,490 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:39,492 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 06:54:39,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:54:39,567 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 06:54:39,574 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) notificationworker stdout | 2022-11-28 06:54:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:52 UTC)" (scheduled at 2022-11-28 06:54:42.901291+00:00) notificationworker stdout | 2022-11-28 06:54:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:54:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:54:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:15 UTC)" (scheduled at 2022-11-28 06:54:45.911636+00:00) securityworker stdout | 2022-11-28 06:54:46,026 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:54:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:17 UTC)" (scheduled at 2022-11-28 06:54:47.016425+00:00) gcworker stdout | 2022-11-28 06:54:47,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:54:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:50 UTC)" (scheduled at 2022-11-28 06:54:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:54:50,196 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:54:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:51 UTC)" (scheduled at 2022-11-28 06:54:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:54:51,810 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:54:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:02 UTC)" (scheduled at 2022-11-28 06:54:52.901291+00:00) notificationworker stdout | 2022-11-28 06:54:52,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:54:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:23 UTC)" (scheduled at 2022-11-28 06:54:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:54:53,168 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:54:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:54:54,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:54:54,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:54:54,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:54:54,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.184 118 0.184) gunicorn-web stdout | 2022-11-28 06:54:54,658 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:54:54,659 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.187 118 0.187) securityscanningnotificationworker stdout | 2022-11-28 06:54:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:56 UTC)" (scheduled at 2022-11-28 06:54:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:54:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:54:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:57 UTC)" (scheduled at 2022-11-28 06:54:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:54:57,674 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:55:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:55:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:12 UTC)" (scheduled at 2022-11-28 06:55:02.901291+00:00) notificationworker stdout | 2022-11-28 06:55:02,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:55:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:03 UTC)" (scheduled at 2022-11-28 06:55:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:55:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:55:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:06 UTC)" (scheduled at 2022-11-28 06:55:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:55:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:55:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:37 UTC)" (scheduled at 2022-11-28 06:55:07.716126+00:00) securityworker stdout | 2022-11-28 06:55:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:55:07,814 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:55:07,815 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:55:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:55:09,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-web stdout | 2022-11-28 06:55:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:55:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:55:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 06:55:09,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:55:09,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 06:55:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:22 UTC)" (scheduled at 2022-11-28 06:55:12.901291+00:00) notificationworker stdout | 2022-11-28 06:55:12,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:55:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:15 UTC)" (scheduled at 2022-11-28 06:55:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:55:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:55:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:45 UTC)" (scheduled at 2022-11-28 06:55:15.911636+00:00) securityworker stdout | 2022-11-28 06:55:15,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:55:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:47 UTC)" (scheduled at 2022-11-28 06:55:17.016425+00:00) gcworker stdout | 2022-11-28 06:55:17,052 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:55:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:32 UTC)" (scheduled at 2022-11-28 06:55:22.901291+00:00) notificationworker stdout | 2022-11-28 06:55:22,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:55:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:53 UTC)" (scheduled at 2022-11-28 06:55:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:55:23,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:55:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 06:55:24,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.013) gunicorn-registry stdout | 2022-11-28 06:55:24,508 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 06:55:24,517 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:24,520 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.014) gunicorn-web stdout | 2022-11-28 06:55:24,535 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:24,538 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:55:24,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:55:24,603 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.130) notificationworker stdout | 2022-11-28 06:55:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:42 UTC)" (scheduled at 2022-11-28 06:55:32.901291+00:00) notificationworker stdout | 2022-11-28 06:55:32,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:55:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:33 UTC)" (scheduled at 2022-11-28 06:55:33.026570+00:00) notificationworker stdout | 2022-11-28 06:55:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:55:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:33 UTC)" (scheduled at 2022-11-28 06:55:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:55:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:55:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:07 UTC)" (scheduled at 2022-11-28 06:55:37.716126+00:00) securityworker stdout | 2022-11-28 06:55:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:55:37,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:55:37,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 06:55:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:55:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:55:39,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:39,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:55:39,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 06:55:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:55:39,561 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) gunicorn-web stdout | 2022-11-28 06:55:39,575 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 06:55:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:00:41 UTC)" (scheduled at 2022-11-28 06:55:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:55:41,200 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:00:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:55:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:52 UTC)" (scheduled at 2022-11-28 06:55:42.901291+00:00) notificationworker stdout | 2022-11-28 06:55:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:55:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:55:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:15 UTC)" (scheduled at 2022-11-28 06:55:45.911636+00:00) securityworker stdout | 2022-11-28 06:55:45,983 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:55:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:17 UTC)" (scheduled at 2022-11-28 06:55:47.016425+00:00) gcworker stdout | 2022-11-28 06:55:47,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:55:48,041 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:00:48 UTC)" (scheduled at 2022-11-28 06:55:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 06:55:48,082 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:00:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:55:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:50 UTC)" (scheduled at 2022-11-28 06:55:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:55:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:55:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:51 UTC)" (scheduled at 2022-11-28 06:55:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:55:51,780 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:55:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:02 UTC)" (scheduled at 2022-11-28 06:55:52.901291+00:00) notificationworker stdout | 2022-11-28 06:55:52,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:55:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:23 UTC)" (scheduled at 2022-11-28 06:55:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:55:53,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:55:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:55:54,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:55:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:54,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:55:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:55:54,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 06:55:54,571 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 06:55:54,576 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 06:55:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:56 UTC)" (scheduled at 2022-11-28 06:55:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:55:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:55:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:57 UTC)" (scheduled at 2022-11-28 06:55:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:55:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:56:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:56:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:12 UTC)" (scheduled at 2022-11-28 06:56:02.901291+00:00) notificationworker stdout | 2022-11-28 06:56:02,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:56:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:03 UTC)" (scheduled at 2022-11-28 06:56:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:56:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:56:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:06 UTC)" (scheduled at 2022-11-28 06:56:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:56:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:56:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:37 UTC)" (scheduled at 2022-11-28 06:56:07.716126+00:00) securityworker stdout | 2022-11-28 06:56:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:56:07,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:56:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:56:09,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:56:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:56:09,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:56:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:56:09,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:09,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.101) gunicorn-web stdout | 2022-11-28 06:56:09,580 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) notificationworker stdout | 2022-11-28 06:56:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:22 UTC)" (scheduled at 2022-11-28 06:56:12.901291+00:00) notificationworker stdout | 2022-11-28 06:56:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:56:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:15 UTC)" (scheduled at 2022-11-28 06:56:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:56:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:56:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:45 UTC)" (scheduled at 2022-11-28 06:56:15.911636+00:00) securityworker stdout | 2022-11-28 06:56:16,071 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:56:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:47 UTC)" (scheduled at 2022-11-28 06:56:17.016425+00:00) gcworker stdout | 2022-11-28 06:56:17,090 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:56:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:32 UTC)" (scheduled at 2022-11-28 06:56:22.901291+00:00) notificationworker stdout | 2022-11-28 06:56:22,991 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:56:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:53 UTC)" (scheduled at 2022-11-28 06:56:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:56:23,193 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:56:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:56:24,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:56:24,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 06:56:24,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:56:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:24,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:56:24,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 06:56:24,568 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) gunicorn-web stdout | 2022-11-28 06:56:24,614 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:56:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:42 UTC)" (scheduled at 2022-11-28 06:56:32.901291+00:00) notificationworker stdout | 2022-11-28 06:56:32,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:56:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:33 UTC)" (scheduled at 2022-11-28 06:56:33.026570+00:00) notificationworker stdout | 2022-11-28 06:56:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:56:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:33 UTC)" (scheduled at 2022-11-28 06:56:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:56:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:56:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:07 UTC)" (scheduled at 2022-11-28 06:56:37.716126+00:00) securityworker stdout | 2022-11-28 06:56:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:56:37,870 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:56:37,871 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:56:39,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:56:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:56:39,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:56:39,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:56:39,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:39,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:39,672 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.200 118 0.200) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.230 118 0.230) gunicorn-web stdout | 2022-11-28 06:56:39,703 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:56:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:52 UTC)" (scheduled at 2022-11-28 06:56:42.901291+00:00) notificationworker stdout | 2022-11-28 06:56:42,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:56:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:56:45,919 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:15 UTC)" (scheduled at 2022-11-28 06:56:45.911636+00:00) securityworker stdout | 2022-11-28 06:56:46,014 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:56:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:17 UTC)" (scheduled at 2022-11-28 06:56:47.016425+00:00) gcworker stdout | 2022-11-28 06:56:47,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:56:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:50 UTC)" (scheduled at 2022-11-28 06:56:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:56:50,217 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:56:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:51 UTC)" (scheduled at 2022-11-28 06:56:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:56:51,777 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:56:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:02 UTC)" (scheduled at 2022-11-28 06:56:52.901291+00:00) notificationworker stdout | 2022-11-28 06:56:52,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:56:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:23 UTC)" (scheduled at 2022-11-28 06:56:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:56:53,246 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.005) gunicorn-registry stdout | 2022-11-28 06:56:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:56:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:56:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:56:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:56:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:56:54,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:56:54,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) securityscanningnotificationworker stdout | 2022-11-28 06:56:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:56 UTC)" (scheduled at 2022-11-28 06:56:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:56:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:56:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:57 UTC)" (scheduled at 2022-11-28 06:56:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:56:57,625 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:57:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:57:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:12 UTC)" (scheduled at 2022-11-28 06:57:02.901291+00:00) notificationworker stdout | 2022-11-28 06:57:02,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:57:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:03 UTC)" (scheduled at 2022-11-28 06:57:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:57:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:57:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:06 UTC)" (scheduled at 2022-11-28 06:57:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:57:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:57:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:37 UTC)" (scheduled at 2022-11-28 06:57:07.716126+00:00) securityworker stdout | 2022-11-28 06:57:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:57:07,853 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:57:07,853 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:57:09,482 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 06:57:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:09,492 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:57:09,494 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:57:09,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:09,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 06:57:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:57:09,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) notificationworker stdout | 2022-11-28 06:57:12,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:22 UTC)" (scheduled at 2022-11-28 06:57:12.901291+00:00) notificationworker stdout | 2022-11-28 06:57:13,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:57:15,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:15 UTC)" (scheduled at 2022-11-28 06:57:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:57:15,039 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:57:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:45 UTC)" (scheduled at 2022-11-28 06:57:15.911636+00:00) securityworker stdout | 2022-11-28 06:57:16,016 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:57:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:47 UTC)" (scheduled at 2022-11-28 06:57:17.016425+00:00) gcworker stdout | 2022-11-28 06:57:17,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:57:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:32 UTC)" (scheduled at 2022-11-28 06:57:22.901291+00:00) notificationworker stdout | 2022-11-28 06:57:22,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:57:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:53 UTC)" (scheduled at 2022-11-28 06:57:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:57:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:57:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:57:24,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:57:24,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:57:24,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:57:24,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:57:24,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 06:57:24,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:57:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:42 UTC)" (scheduled at 2022-11-28 06:57:32.901291+00:00) notificationworker stdout | 2022-11-28 06:57:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:57:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:33 UTC)" (scheduled at 2022-11-28 06:57:33.026570+00:00) notificationworker stdout | 2022-11-28 06:57:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:57:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:33 UTC)" (scheduled at 2022-11-28 06:57:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:57:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:57:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:07 UTC)" (scheduled at 2022-11-28 06:57:37.716126+00:00) securityworker stdout | 2022-11-28 06:57:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:57:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:57:37,788 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:57:39,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:57:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:57:39,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:39,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:57:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:39,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:57:39,610 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) gunicorn-web stdout | 2022-11-28 06:57:39,617 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) notificationworker stdout | 2022-11-28 06:57:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:52 UTC)" (scheduled at 2022-11-28 06:57:42.901291+00:00) notificationworker stdout | 2022-11-28 06:57:42,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:57:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:57:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:15 UTC)" (scheduled at 2022-11-28 06:57:45.911636+00:00) securityworker stdout | 2022-11-28 06:57:45,997 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:57:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:17 UTC)" (scheduled at 2022-11-28 06:57:47.016425+00:00) gcworker stdout | 2022-11-28 06:57:47,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:57:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:50 UTC)" (scheduled at 2022-11-28 06:57:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:57:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:57:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:51 UTC)" (scheduled at 2022-11-28 06:57:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:57:51,785 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:57:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:02 UTC)" (scheduled at 2022-11-28 06:57:52.901291+00:00) notificationworker stdout | 2022-11-28 06:57:52,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:57:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:23 UTC)" (scheduled at 2022-11-28 06:57:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:57:53,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:57:54,507 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:57:54,510 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:57:54,529 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:54,532 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:57:54,532 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:57:54,533 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:57:54,584 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 06:57:54,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) securityscanningnotificationworker stdout | 2022-11-28 06:57:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:56 UTC)" (scheduled at 2022-11-28 06:57:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:57:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:57:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:57 UTC)" (scheduled at 2022-11-28 06:57:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:57:57,559 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:58:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:58:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:12 UTC)" (scheduled at 2022-11-28 06:58:02.901291+00:00) notificationworker stdout | 2022-11-28 06:58:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:58:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:03 UTC)" (scheduled at 2022-11-28 06:58:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:58:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:58:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:06 UTC)" (scheduled at 2022-11-28 06:58:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:58:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:58:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:37 UTC)" (scheduled at 2022-11-28 06:58:07.716126+00:00) securityworker stdout | 2022-11-28 06:58:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:58:07,788 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:58:07,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:58:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:58:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:58:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:58:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 06:58:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 06:58:09,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:58:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:22 UTC)" (scheduled at 2022-11-28 06:58:12.901291+00:00) notificationworker stdout | 2022-11-28 06:58:12,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:58:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:15 UTC)" (scheduled at 2022-11-28 06:58:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:58:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:58:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:45 UTC)" (scheduled at 2022-11-28 06:58:15.911636+00:00) securityworker stdout | 2022-11-28 06:58:15,971 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:58:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:47 UTC)" (scheduled at 2022-11-28 06:58:17.016425+00:00) gcworker stdout | 2022-11-28 06:58:17,098 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:58:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:32 UTC)" (scheduled at 2022-11-28 06:58:22.901291+00:00) notificationworker stdout | 2022-11-28 06:58:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:58:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:53 UTC)" (scheduled at 2022-11-28 06:58:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:58:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:58:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:58:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:58:24,497 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:58:24,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:24,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 06:58:24,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:24,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:58:24,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 06:58:24,577 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) notificationworker stdout | 2022-11-28 06:58:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:42 UTC)" (scheduled at 2022-11-28 06:58:32.901291+00:00) notificationworker stdout | 2022-11-28 06:58:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:58:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:33 UTC)" (scheduled at 2022-11-28 06:58:33.026570+00:00) notificationworker stdout | 2022-11-28 06:58:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:58:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:33 UTC)" (scheduled at 2022-11-28 06:58:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:58:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:58:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:07 UTC)" (scheduled at 2022-11-28 06:58:37.716126+00:00) securityworker stdout | 2022-11-28 06:58:37,741 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:58:37,813 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:58:37,813 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:58:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:03:38 UTC)" (scheduled at 2022-11-28 06:58:38.420756+00:00) namespacegcworker stdout | 2022-11-28 06:58:38,521 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:03:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 06:58:39,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:58:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:39,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:58:39,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 06:58:39,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:58:39,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) notificationworker stdout | 2022-11-28 06:58:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:52 UTC)" (scheduled at 2022-11-28 06:58:42.901291+00:00) notificationworker stdout | 2022-11-28 06:58:42,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:58:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:58:45,921 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:15 UTC)" (scheduled at 2022-11-28 06:58:45.911636+00:00) securityworker stdout | 2022-11-28 06:58:45,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:58:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:17 UTC)" (scheduled at 2022-11-28 06:58:47.016425+00:00) gcworker stdout | 2022-11-28 06:58:47,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:58:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:03:49 UTC)" (scheduled at 2022-11-28 06:58:49.405459+00:00) repositorygcworker stdout | 2022-11-28 06:58:49,447 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:03:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:58:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:50 UTC)" (scheduled at 2022-11-28 06:58:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:58:50,158 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:58:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:51 UTC)" (scheduled at 2022-11-28 06:58:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:58:51,776 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:58:52,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:02 UTC)" (scheduled at 2022-11-28 06:58:52.901291+00:00) notificationworker stdout | 2022-11-28 06:58:52,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:58:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:23 UTC)" (scheduled at 2022-11-28 06:58:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:58:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 06:58:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:58:54,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:54,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 06:58:54,499 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:58:54,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:58:54,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:58:54,553 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 06:58:54,592 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 06:58:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:56 UTC)" (scheduled at 2022-11-28 06:58:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:58:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:58:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:57 UTC)" (scheduled at 2022-11-28 06:58:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:58:57,626 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 06:59:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:59:02,907 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:12 UTC)" (scheduled at 2022-11-28 06:59:02.901291+00:00) notificationworker stdout | 2022-11-28 06:59:02,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:59:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:03 UTC)" (scheduled at 2022-11-28 06:59:03.406131+00:00) repositorygcworker stdout | 2022-11-28 06:59:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:59:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:06 UTC)" (scheduled at 2022-11-28 06:59:06.421235+00:00) namespacegcworker stdout | 2022-11-28 06:59:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:06 UTC)" executed successfully securityworker stdout | 2022-11-28 06:59:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:37 UTC)" (scheduled at 2022-11-28 06:59:07.716126+00:00) securityworker stdout | 2022-11-28 06:59:07,798 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:59:08,002 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:59:08,007 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:59:09,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 06:59:09,485 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:59:09,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:09,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:59:09,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:09,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 06:59:09,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 06:59:09,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:59:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:22 UTC)" (scheduled at 2022-11-28 06:59:12.901291+00:00) notificationworker stdout | 2022-11-28 06:59:12,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:59:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:15 UTC)" (scheduled at 2022-11-28 06:59:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 06:59:15,039 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:15 UTC)" executed successfully securityworker stdout | 2022-11-28 06:59:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:45 UTC)" (scheduled at 2022-11-28 06:59:15.911636+00:00) securityworker stdout | 2022-11-28 06:59:15,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:45 UTC)" executed successfully gcworker stdout | 2022-11-28 06:59:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:47 UTC)" (scheduled at 2022-11-28 06:59:17.016425+00:00) gcworker stdout | 2022-11-28 06:59:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:59:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:32 UTC)" (scheduled at 2022-11-28 06:59:22.901291+00:00) notificationworker stdout | 2022-11-28 06:59:22,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:59:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:53 UTC)" (scheduled at 2022-11-28 06:59:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:59:23,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 06:59:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:59:24,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:59:24,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:59:24,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:24,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 06:59:24,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) gunicorn-web stdout | 2022-11-28 06:59:24,609 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) gunicorn-web stdout | 2022-11-28 06:59:24,613 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 06:59:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:42 UTC)" (scheduled at 2022-11-28 06:59:32.901291+00:00) notificationworker stdout | 2022-11-28 06:59:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:33 UTC)" (scheduled at 2022-11-28 06:59:33.026570+00:00) notificationworker stdout | 2022-11-28 06:59:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:59:33,089 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 06:59:33,326 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:33 UTC)" (scheduled at 2022-11-28 06:59:33.321475+00:00) repositorygcworker stdout | 2022-11-28 06:59:33,436 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:33 UTC)" executed successfully securityworker stdout | 2022-11-28 06:59:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:07 UTC)" (scheduled at 2022-11-28 06:59:37.716126+00:00) securityworker stdout | 2022-11-28 06:59:37,751 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 06:59:37,866 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 06:59:37,866 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:59:38,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:04:38 UTC)" (scheduled at 2022-11-28 06:59:38.024004+00:00) notificationworker stdout | 2022-11-28 06:59:38,084 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:04:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 06:59:39,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 06:59:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:59:39,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:39,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:59:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 06:59:39,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 06:59:39,540 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:59:39,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 06:59:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:52 UTC)" (scheduled at 2022-11-28 06:59:42.901291+00:00) notificationworker stdout | 2022-11-28 06:59:42,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 06:59:52 UTC)" executed successfully securityworker stdout | 2022-11-28 06:59:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:15 UTC)" (scheduled at 2022-11-28 06:59:45.911636+00:00) securityworker stdout | 2022-11-28 06:59:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:15 UTC)" executed successfully gcworker stdout | 2022-11-28 06:59:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:17 UTC)" (scheduled at 2022-11-28 06:59:47.016425+00:00) gcworker stdout | 2022-11-28 06:59:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 06:59:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:50 UTC)" (scheduled at 2022-11-28 06:59:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 06:59:50,178 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 06:59:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:51 UTC)" (scheduled at 2022-11-28 06:59:51.733764+00:00) namespacegcworker stdout | 2022-11-28 06:59:51,797 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 06:59:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:02 UTC)" (scheduled at 2022-11-28 06:59:52.901291+00:00) notificationworker stdout | 2022-11-28 06:59:52,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 06:59:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:23 UTC)" (scheduled at 2022-11-28 06:59:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 06:59:53,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 06:59:54,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 06:59:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 06:59:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:59:54,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 06:59:54,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 06:59:54,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 06:59:54,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 06:59:54,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:06:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:06:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) securityscanningnotificationworker stdout | 2022-11-28 06:59:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:56 UTC)" (scheduled at 2022-11-28 06:59:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:59:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 06:59:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:57 UTC)" (scheduled at 2022-11-28 06:59:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 06:59:57,605 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:00:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:00:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:12 UTC)" (scheduled at 2022-11-28 07:00:02.901291+00:00) notificationworker stdout | 2022-11-28 07:00:02,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:00:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:03 UTC)" (scheduled at 2022-11-28 07:00:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:00:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:00:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:06 UTC)" (scheduled at 2022-11-28 07:00:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:00:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:00:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:37 UTC)" (scheduled at 2022-11-28 07:00:07.716126+00:00) securityworker stdout | 2022-11-28 07:00:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:00:07,830 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:00:07,831 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:00:09,482 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:00:09,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:00:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:00:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:00:09,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:00:09,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:00:09,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:00:09,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) notificationworker stdout | 2022-11-28 07:00:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:22 UTC)" (scheduled at 2022-11-28 07:00:12.901291+00:00) notificationworker stdout | 2022-11-28 07:00:13,095 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:00:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:15 UTC)" (scheduled at 2022-11-28 07:00:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:00:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:00:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:45 UTC)" (scheduled at 2022-11-28 07:00:15.911636+00:00) securityworker stdout | 2022-11-28 07:00:16,061 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:00:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:47 UTC)" (scheduled at 2022-11-28 07:00:17.016425+00:00) gcworker stdout | 2022-11-28 07:00:17,087 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:00:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:32 UTC)" (scheduled at 2022-11-28 07:00:22.901291+00:00) notificationworker stdout | 2022-11-28 07:00:23,002 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:00:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:53 UTC)" (scheduled at 2022-11-28 07:00:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:00:23,248 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:00:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:00:24,498 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:00:24,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:00:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:00:24,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:00:24,513 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:00:24,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.117) gunicorn-web stdout | 2022-11-28 07:00:24,591 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.139) gunicorn-web stdout | 2022-11-28 07:00:24,612 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:00:32,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:42 UTC)" (scheduled at 2022-11-28 07:00:32.901291+00:00) notificationworker stdout | 2022-11-28 07:00:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:33 UTC)" (scheduled at 2022-11-28 07:00:33.026570+00:00) notificationworker stdout | 2022-11-28 07:00:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:00:33,137 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:00:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:33 UTC)" (scheduled at 2022-11-28 07:00:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:00:33,562 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:00:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:07 UTC)" (scheduled at 2022-11-28 07:00:37.716126+00:00) securityworker stdout | 2022-11-28 07:00:37,746 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:00:37,837 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:00:37,838 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:00:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:00:39,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 07:00:39,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:00:39,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:00:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:00:39,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:00:39,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 07:00:39,574 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:00:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:05:41 UTC)" (scheduled at 2022-11-28 07:00:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:00:41,223 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:05:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:00:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:52 UTC)" (scheduled at 2022-11-28 07:00:42.901291+00:00) notificationworker stdout | 2022-11-28 07:00:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:00:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:00:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:15 UTC)" (scheduled at 2022-11-28 07:00:45.911636+00:00) securityworker stdout | 2022-11-28 07:00:45,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:00:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:17 UTC)" (scheduled at 2022-11-28 07:00:47.016425+00:00) gcworker stdout | 2022-11-28 07:00:47,079 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:00:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:05:48 UTC)" (scheduled at 2022-11-28 07:00:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:00:48,110 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:05:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:00:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:50 UTC)" (scheduled at 2022-11-28 07:00:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:00:50,179 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:00:51,740 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:51 UTC)" (scheduled at 2022-11-28 07:00:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:00:51,866 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:00:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:02 UTC)" (scheduled at 2022-11-28 07:00:52.901291+00:00) notificationworker stdout | 2022-11-28 07:00:52,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:00:53,120 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:23 UTC)" (scheduled at 2022-11-28 07:00:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:00:53,197 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:00:54,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:00:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:00:54,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:00:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:00:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:00:54,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:00:54,614 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.142 118 0.143) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) gunicorn-web stdout | 2022-11-28 07:00:54,618 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:00:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:56 UTC)" (scheduled at 2022-11-28 07:00:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:00:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:00:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:57 UTC)" (scheduled at 2022-11-28 07:00:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:00:57,569 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:01:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:01:02,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:12 UTC)" (scheduled at 2022-11-28 07:01:02.901291+00:00) notificationworker stdout | 2022-11-28 07:01:02,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:01:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:03 UTC)" (scheduled at 2022-11-28 07:01:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:01:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:01:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:06 UTC)" (scheduled at 2022-11-28 07:01:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:01:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:01:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:37 UTC)" (scheduled at 2022-11-28 07:01:07.716126+00:00) securityworker stdout | 2022-11-28 07:01:07,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:01:07,802 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:01:07,802 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:01:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:01:09,485 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:01:09,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:01:09,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:09,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 07:01:09,530 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:01:09,530 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) notificationworker stdout | 2022-11-28 07:01:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:22 UTC)" (scheduled at 2022-11-28 07:01:12.901291+00:00) notificationworker stdout | 2022-11-28 07:01:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:01:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:15 UTC)" (scheduled at 2022-11-28 07:01:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:01:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:01:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:45 UTC)" (scheduled at 2022-11-28 07:01:15.911636+00:00) securityworker stdout | 2022-11-28 07:01:15,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:01:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:47 UTC)" (scheduled at 2022-11-28 07:01:17.016425+00:00) gcworker stdout | 2022-11-28 07:01:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:01:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:32 UTC)" (scheduled at 2022-11-28 07:01:22.901291+00:00) notificationworker stdout | 2022-11-28 07:01:22,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:01:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:53 UTC)" (scheduled at 2022-11-28 07:01:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:01:23,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:01:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:01:24,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:01:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:01:24,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:24,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.007) gunicorn-web stdout | 2022-11-28 07:01:24,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:24,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:01:24,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 07:01:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:42 UTC)" (scheduled at 2022-11-28 07:01:32.901291+00:00) notificationworker stdout | 2022-11-28 07:01:32,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:01:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:33 UTC)" (scheduled at 2022-11-28 07:01:33.026570+00:00) notificationworker stdout | 2022-11-28 07:01:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:01:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:33 UTC)" (scheduled at 2022-11-28 07:01:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:01:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:01:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:07 UTC)" (scheduled at 2022-11-28 07:01:37.716126+00:00) securityworker stdout | 2022-11-28 07:01:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:01:37,764 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:01:37,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:01:39,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:01:39,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:01:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:39,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:01:39,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.121 118 0.121) gunicorn-web stdout | 2022-11-28 07:01:39,594 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:01:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:52 UTC)" (scheduled at 2022-11-28 07:01:42.901291+00:00) notificationworker stdout | 2022-11-28 07:01:42,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:01:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:01:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:15 UTC)" (scheduled at 2022-11-28 07:01:45.911636+00:00) securityworker stdout | 2022-11-28 07:01:45,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:01:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:17 UTC)" (scheduled at 2022-11-28 07:01:47.016425+00:00) gcworker stdout | 2022-11-28 07:01:47,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:01:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:50 UTC)" (scheduled at 2022-11-28 07:01:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:01:50,174 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:01:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:51 UTC)" (scheduled at 2022-11-28 07:01:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:01:51,812 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:01:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:02 UTC)" (scheduled at 2022-11-28 07:01:52.901291+00:00) notificationworker stdout | 2022-11-28 07:01:52,998 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:01:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:23 UTC)" (scheduled at 2022-11-28 07:01:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:01:53,199 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:01:54,482 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:01:54,482 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:01:54,491 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:54,491 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:01:54,492 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:54,492 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:01:54,655 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.184 118 0.183) gunicorn-web stdout | 2022-11-28 07:01:54,670 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.201 118 0.201) securityscanningnotificationworker stdout | 2022-11-28 07:01:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:56 UTC)" (scheduled at 2022-11-28 07:01:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:01:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:01:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:57 UTC)" (scheduled at 2022-11-28 07:01:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:01:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:02:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:02:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:12 UTC)" (scheduled at 2022-11-28 07:02:02.901291+00:00) notificationworker stdout | 2022-11-28 07:02:02,990 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:02:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:03 UTC)" (scheduled at 2022-11-28 07:02:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:02:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:02:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:06 UTC)" (scheduled at 2022-11-28 07:02:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:02:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:02:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:37 UTC)" (scheduled at 2022-11-28 07:02:07.716126+00:00) securityworker stdout | 2022-11-28 07:02:07,747 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:02:07,789 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:02:07,790 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:02:09,483 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:02:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:02:09,491 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:02:09,492 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:09,493 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:02:09,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 07:02:09,534 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:02:09,534 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) notificationworker stdout | 2022-11-28 07:02:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:22 UTC)" (scheduled at 2022-11-28 07:02:12.901291+00:00) notificationworker stdout | 2022-11-28 07:02:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:02:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:15 UTC)" (scheduled at 2022-11-28 07:02:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:02:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:02:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:45 UTC)" (scheduled at 2022-11-28 07:02:15.911636+00:00) securityworker stdout | 2022-11-28 07:02:15,973 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:02:17,023 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:47 UTC)" (scheduled at 2022-11-28 07:02:17.016425+00:00) gcworker stdout | 2022-11-28 07:02:17,096 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:02:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:32 UTC)" (scheduled at 2022-11-28 07:02:22.901291+00:00) notificationworker stdout | 2022-11-28 07:02:22,993 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:02:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:53 UTC)" (scheduled at 2022-11-28 07:02:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:02:23,180 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:02:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:02:24,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:02:24,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:24,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:02:24,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:24,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:02:24,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:02:24,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:02:24,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 07:02:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:42 UTC)" (scheduled at 2022-11-28 07:02:32.901291+00:00) notificationworker stdout | 2022-11-28 07:02:32,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:02:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:33 UTC)" (scheduled at 2022-11-28 07:02:33.026570+00:00) notificationworker stdout | 2022-11-28 07:02:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:02:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:33 UTC)" (scheduled at 2022-11-28 07:02:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:02:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:02:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:07 UTC)" (scheduled at 2022-11-28 07:02:37.716126+00:00) securityworker stdout | 2022-11-28 07:02:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:02:37,758 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:02:37,758 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:02:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:02:39,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:02:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:02:39,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:02:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:02:39,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:02:39,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 07:02:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:52 UTC)" (scheduled at 2022-11-28 07:02:42.901291+00:00) notificationworker stdout | 2022-11-28 07:02:43,043 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:02:52 UTC)" executed successfully servicekey stdout | 2022-11-28 07:02:44,410 [95] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 07:57:44 UTC)" (scheduled at 2022-11-28 07:02:44.408575+00:00) servicekey stdout | 2022-11-28 07:02:44,467 [95] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 07:57:44 UTC)" executed successfully securityworker stdout | 2022-11-28 07:02:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:15 UTC)" (scheduled at 2022-11-28 07:02:45.911636+00:00) securityworker stdout | 2022-11-28 07:02:46,028 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:02:47,030 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:17 UTC)" (scheduled at 2022-11-28 07:02:47.016425+00:00) gcworker stdout | 2022-11-28 07:02:47,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:02:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:50 UTC)" (scheduled at 2022-11-28 07:02:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:02:50,187 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:02:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:51 UTC)" (scheduled at 2022-11-28 07:02:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:02:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:02:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:02 UTC)" (scheduled at 2022-11-28 07:02:52.901291+00:00) notificationworker stdout | 2022-11-28 07:02:52,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:02:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:23 UTC)" (scheduled at 2022-11-28 07:02:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:02:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:02:54,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:02:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:02:54,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:02:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:02:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 07:02:54,593 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 07:02:54,598 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:02:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:56 UTC)" (scheduled at 2022-11-28 07:02:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:02:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:02:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:57 UTC)" (scheduled at 2022-11-28 07:02:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:02:57,546 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:03:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:03:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:12 UTC)" (scheduled at 2022-11-28 07:03:02.901291+00:00) notificationworker stdout | 2022-11-28 07:03:02,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:03:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:03 UTC)" (scheduled at 2022-11-28 07:03:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:03:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:03:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:06 UTC)" (scheduled at 2022-11-28 07:03:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:03:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:03:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:37 UTC)" (scheduled at 2022-11-28 07:03:07.716126+00:00) securityworker stdout | 2022-11-28 07:03:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:03:07,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:03:07,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:03:09,487 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:03:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 07:03:09,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:03:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:03:09,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:03:09,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:03:09,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.082) gunicorn-web stdout | 2022-11-28 07:03:09,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:03:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:22 UTC)" (scheduled at 2022-11-28 07:03:12.901291+00:00) notificationworker stdout | 2022-11-28 07:03:12,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:03:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:15 UTC)" (scheduled at 2022-11-28 07:03:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:03:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:03:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:45 UTC)" (scheduled at 2022-11-28 07:03:15.911636+00:00) securityworker stdout | 2022-11-28 07:03:15,995 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:03:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:47 UTC)" (scheduled at 2022-11-28 07:03:17.016425+00:00) gcworker stdout | 2022-11-28 07:03:17,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:03:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:32 UTC)" (scheduled at 2022-11-28 07:03:22.901291+00:00) notificationworker stdout | 2022-11-28 07:03:22,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:03:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:53 UTC)" (scheduled at 2022-11-28 07:03:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:03:23,160 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:03:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:03:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:03:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:03:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:03:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:03:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:03:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 07:03:24,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:03:24,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.079) notificationworker stdout | 2022-11-28 07:03:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:42 UTC)" (scheduled at 2022-11-28 07:03:32.901291+00:00) notificationworker stdout | 2022-11-28 07:03:32,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:03:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:33 UTC)" (scheduled at 2022-11-28 07:03:33.026570+00:00) notificationworker stdout | 2022-11-28 07:03:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:03:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:33 UTC)" (scheduled at 2022-11-28 07:03:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:03:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:03:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:07 UTC)" (scheduled at 2022-11-28 07:03:37.716126+00:00) securityworker stdout | 2022-11-28 07:03:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:03:37,815 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:03:37,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:03:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:08:38 UTC)" (scheduled at 2022-11-28 07:03:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:03:38,511 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:08:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:03:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:03:39,504 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:03:39,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:03:39,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:03:39,514 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:03:39,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 07:03:39,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:03:39,573 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) notificationworker stdout | 2022-11-28 07:03:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:52 UTC)" (scheduled at 2022-11-28 07:03:42.901291+00:00) notificationworker stdout | 2022-11-28 07:03:42,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:03:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:03:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:15 UTC)" (scheduled at 2022-11-28 07:03:45.911636+00:00) securityworker stdout | 2022-11-28 07:03:46,023 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:03:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:17 UTC)" (scheduled at 2022-11-28 07:03:47.016425+00:00) gcworker stdout | 2022-11-28 07:03:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:03:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:08:49 UTC)" (scheduled at 2022-11-28 07:03:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:03:49,457 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:08:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:03:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:50 UTC)" (scheduled at 2022-11-28 07:03:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:03:50,177 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:03:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:51 UTC)" (scheduled at 2022-11-28 07:03:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:03:51,794 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:03:52,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:02 UTC)" (scheduled at 2022-11-28 07:03:52.901291+00:00) notificationworker stdout | 2022-11-28 07:03:52,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:03:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:23 UTC)" (scheduled at 2022-11-28 07:03:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:03:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:03:54,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:03:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:03:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:03:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:03:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:03:54,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.153 118 0.153) gunicorn-web stdout | 2022-11-28 07:03:54,625 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.176 118 0.176) gunicorn-web stdout | 2022-11-28 07:03:54,649 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:03:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:56 UTC)" (scheduled at 2022-11-28 07:03:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:03:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:03:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:57 UTC)" (scheduled at 2022-11-28 07:03:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:03:57,643 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:04:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:04:02,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:12 UTC)" (scheduled at 2022-11-28 07:04:02.901291+00:00) notificationworker stdout | 2022-11-28 07:04:02,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:04:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:03 UTC)" (scheduled at 2022-11-28 07:04:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:04:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:04:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:06 UTC)" (scheduled at 2022-11-28 07:04:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:04:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:04:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:37 UTC)" (scheduled at 2022-11-28 07:04:07.716126+00:00) securityworker stdout | 2022-11-28 07:04:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:04:07,932 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:04:07,933 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:04:09,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:04:09,501 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:04:09,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:09,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 07:04:09,517 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:09,519 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.127 118 0.126) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.127) gunicorn-web stdout | 2022-11-28 07:04:09,599 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:04:09,600 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:04:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:22 UTC)" (scheduled at 2022-11-28 07:04:12.901291+00:00) notificationworker stdout | 2022-11-28 07:04:12,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:04:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:15 UTC)" (scheduled at 2022-11-28 07:04:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:04:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:04:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:45 UTC)" (scheduled at 2022-11-28 07:04:15.911636+00:00) securityworker stdout | 2022-11-28 07:04:16,117 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:04:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:47 UTC)" (scheduled at 2022-11-28 07:04:17.016425+00:00) gcworker stdout | 2022-11-28 07:04:17,083 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:04:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:32 UTC)" (scheduled at 2022-11-28 07:04:22.901291+00:00) notificationworker stdout | 2022-11-28 07:04:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:04:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:53 UTC)" (scheduled at 2022-11-28 07:04:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:04:23,186 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:04:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:04:24,483 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) gunicorn-registry stdout | 2022-11-28 07:04:24,497 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:04:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:04:24,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:24,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.123) gunicorn-web stdout | 2022-11-28 07:04:24,594 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) gunicorn-web stdout | 2022-11-28 07:04:24,606 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:04:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:42 UTC)" (scheduled at 2022-11-28 07:04:32.901291+00:00) notificationworker stdout | 2022-11-28 07:04:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:04:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:33 UTC)" (scheduled at 2022-11-28 07:04:33.026570+00:00) notificationworker stdout | 2022-11-28 07:04:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:04:33,325 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:33 UTC)" (scheduled at 2022-11-28 07:04:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:04:33,365 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:04:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:07 UTC)" (scheduled at 2022-11-28 07:04:37.716126+00:00) securityworker stdout | 2022-11-28 07:04:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:04:37,807 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:04:37,808 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:04:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:09:38 UTC)" (scheduled at 2022-11-28 07:04:38.024004+00:00) notificationworker stdout | 2022-11-28 07:04:38,084 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:09:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:04:39,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:04:39,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:04:39,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:39,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:04:39,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:04:39,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 07:04:39,555 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 07:04:39,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:04:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:52 UTC)" (scheduled at 2022-11-28 07:04:42.901291+00:00) notificationworker stdout | 2022-11-28 07:04:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:04:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:04:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:15 UTC)" (scheduled at 2022-11-28 07:04:45.911636+00:00) securityworker stdout | 2022-11-28 07:04:46,012 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:04:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:17 UTC)" (scheduled at 2022-11-28 07:04:47.016425+00:00) gcworker stdout | 2022-11-28 07:04:47,105 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:04:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:50 UTC)" (scheduled at 2022-11-28 07:04:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:04:50,168 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:04:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:51 UTC)" (scheduled at 2022-11-28 07:04:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:04:51,786 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:04:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:02 UTC)" (scheduled at 2022-11-28 07:04:52.901291+00:00) notificationworker stdout | 2022-11-28 07:04:52,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:04:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:23 UTC)" (scheduled at 2022-11-28 07:04:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:04:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:04:54,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:54,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-registry stdout | 2022-11-28 07:04:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:04:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:04:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:04:54,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 07:04:54,554 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:04:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:56 UTC)" (scheduled at 2022-11-28 07:04:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:04:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:04:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:57 UTC)" (scheduled at 2022-11-28 07:04:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:04:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:05:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:05:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:12 UTC)" (scheduled at 2022-11-28 07:05:02.901291+00:00) notificationworker stdout | 2022-11-28 07:05:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:05:03,409 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:03 UTC)" (scheduled at 2022-11-28 07:05:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:05:03,410 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:05:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:06 UTC)" (scheduled at 2022-11-28 07:05:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:05:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:05:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:37 UTC)" (scheduled at 2022-11-28 07:05:07.716126+00:00) securityworker stdout | 2022-11-28 07:05:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:05:07,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:05:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:05:09,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:05:09,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:05:09,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:05:09,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:05:09,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:05:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:05:09,591 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 07:05:09,601 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.129) notificationworker stdout | 2022-11-28 07:05:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:22 UTC)" (scheduled at 2022-11-28 07:05:12.901291+00:00) notificationworker stdout | 2022-11-28 07:05:12,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:05:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:15 UTC)" (scheduled at 2022-11-28 07:05:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:05:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:05:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:45 UTC)" (scheduled at 2022-11-28 07:05:15.911636+00:00) securityworker stdout | 2022-11-28 07:05:16,007 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:05:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:47 UTC)" (scheduled at 2022-11-28 07:05:17.016425+00:00) gcworker stdout | 2022-11-28 07:05:17,099 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:05:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:32 UTC)" (scheduled at 2022-11-28 07:05:22.901291+00:00) notificationworker stdout | 2022-11-28 07:05:22,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:05:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:53 UTC)" (scheduled at 2022-11-28 07:05:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:05:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:05:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.002) gunicorn-registry stdout | 2022-11-28 07:05:24,501 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:05:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:05:24,518 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:05:24,522 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:05:24,523 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:05:24,532 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.127 118 0.128) gunicorn-web stdout | 2022-11-28 07:05:24,599 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) gunicorn-web stdout | 2022-11-28 07:05:24,623 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:05:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:42 UTC)" (scheduled at 2022-11-28 07:05:32.901291+00:00) notificationworker stdout | 2022-11-28 07:05:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:05:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:33 UTC)" (scheduled at 2022-11-28 07:05:33.026570+00:00) notificationworker stdout | 2022-11-28 07:05:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:05:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:33 UTC)" (scheduled at 2022-11-28 07:05:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:05:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:05:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:07 UTC)" (scheduled at 2022-11-28 07:05:37.716126+00:00) securityworker stdout | 2022-11-28 07:05:37,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:05:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:05:37,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:05:39,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:05:39,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:05:39,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:05:39,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:05:39,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:05:39,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.087) gunicorn-web stdout | 2022-11-28 07:05:39,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:05:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.090) securityscanningnotificationworker stdout | 2022-11-28 07:05:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:10:41 UTC)" (scheduled at 2022-11-28 07:05:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:05:41,195 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:10:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:05:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:52 UTC)" (scheduled at 2022-11-28 07:05:42.901291+00:00) notificationworker stdout | 2022-11-28 07:05:42,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:05:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:05:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:15 UTC)" (scheduled at 2022-11-28 07:05:45.911636+00:00) securityworker stdout | 2022-11-28 07:05:45,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:05:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:17 UTC)" (scheduled at 2022-11-28 07:05:47.016425+00:00) gcworker stdout | 2022-11-28 07:05:47,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:05:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:10:48 UTC)" (scheduled at 2022-11-28 07:05:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:05:48,121 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:10:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:05:50,132 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:50 UTC)" (scheduled at 2022-11-28 07:05:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:05:50,230 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:05:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:51 UTC)" (scheduled at 2022-11-28 07:05:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:05:51,823 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:05:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:02 UTC)" (scheduled at 2022-11-28 07:05:52.901291+00:00) notificationworker stdout | 2022-11-28 07:05:52,985 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:05:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:23 UTC)" (scheduled at 2022-11-28 07:05:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:05:53,192 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:05:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:05:54,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:05:54,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:05:54,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:05:54,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:05:54,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:05:54,565 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:05:54,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) securityscanningnotificationworker stdout | 2022-11-28 07:05:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:56 UTC)" (scheduled at 2022-11-28 07:05:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:05:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:05:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:57 UTC)" (scheduled at 2022-11-28 07:05:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:05:57,686 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:06:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:06:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:12 UTC)" (scheduled at 2022-11-28 07:06:02.901291+00:00) notificationworker stdout | 2022-11-28 07:06:02,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:06:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:03 UTC)" (scheduled at 2022-11-28 07:06:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:06:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:06:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:06 UTC)" (scheduled at 2022-11-28 07:06:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:06:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:06:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:37 UTC)" (scheduled at 2022-11-28 07:06:07.716126+00:00) securityworker stdout | 2022-11-28 07:06:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:06:07,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:06:07,781 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:06:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:06:09,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:09,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:09,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:06:09,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:06:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:06:09,537 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:06:09,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) notificationworker stdout | 2022-11-28 07:06:12,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:22 UTC)" (scheduled at 2022-11-28 07:06:12.901291+00:00) notificationworker stdout | 2022-11-28 07:06:12,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:06:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:15 UTC)" (scheduled at 2022-11-28 07:06:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:06:15,039 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:06:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:45 UTC)" (scheduled at 2022-11-28 07:06:15.911636+00:00) securityworker stdout | 2022-11-28 07:06:16,009 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:06:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:47 UTC)" (scheduled at 2022-11-28 07:06:17.016425+00:00) gcworker stdout | 2022-11-28 07:06:17,077 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:06:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:32 UTC)" (scheduled at 2022-11-28 07:06:22.901291+00:00) notificationworker stdout | 2022-11-28 07:06:22,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:06:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:53 UTC)" (scheduled at 2022-11-28 07:06:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:06:23,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:06:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:06:24,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-web stdout | 2022-11-28 07:06:24,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:06:24,510 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:06:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:24,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:06:24,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:06:24,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.094) notificationworker stdout | 2022-11-28 07:06:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:42 UTC)" (scheduled at 2022-11-28 07:06:32.901291+00:00) notificationworker stdout | 2022-11-28 07:06:32,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:06:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:33 UTC)" (scheduled at 2022-11-28 07:06:33.026570+00:00) notificationworker stdout | 2022-11-28 07:06:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:06:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:33 UTC)" (scheduled at 2022-11-28 07:06:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:06:33,366 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:06:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:07 UTC)" (scheduled at 2022-11-28 07:06:37.716126+00:00) securityworker stdout | 2022-11-28 07:06:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:06:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:06:37,774 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:06:39,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:39,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:06:39,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) gunicorn-registry stdout | 2022-11-28 07:06:39,499 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:06:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:06:39,544 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:06:39,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:06:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:52 UTC)" (scheduled at 2022-11-28 07:06:42.901291+00:00) notificationworker stdout | 2022-11-28 07:06:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:06:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:06:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:15 UTC)" (scheduled at 2022-11-28 07:06:45.911636+00:00) securityworker stdout | 2022-11-28 07:06:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:06:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:17 UTC)" (scheduled at 2022-11-28 07:06:47.016425+00:00) gcworker stdout | 2022-11-28 07:06:47,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:06:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:50 UTC)" (scheduled at 2022-11-28 07:06:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:06:50,185 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:06:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:51 UTC)" (scheduled at 2022-11-28 07:06:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:06:51,776 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:06:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:02 UTC)" (scheduled at 2022-11-28 07:06:52.901291+00:00) notificationworker stdout | 2022-11-28 07:06:52,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:06:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:23 UTC)" (scheduled at 2022-11-28 07:06:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:06:53,181 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:06:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:06:54,492 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:06:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:06:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:06:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:06:54,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:06:54,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) securityscanningnotificationworker stdout | 2022-11-28 07:06:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:56 UTC)" (scheduled at 2022-11-28 07:06:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:06:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:06:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:57 UTC)" (scheduled at 2022-11-28 07:06:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:06:57,556 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:07:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:07:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:12 UTC)" (scheduled at 2022-11-28 07:07:02.901291+00:00) notificationworker stdout | 2022-11-28 07:07:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:07:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:03 UTC)" (scheduled at 2022-11-28 07:07:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:07:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:07:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:06 UTC)" (scheduled at 2022-11-28 07:07:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:07:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:07:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:37 UTC)" (scheduled at 2022-11-28 07:07:07.716126+00:00) securityworker stdout | 2022-11-28 07:07:07,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:07:07,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:07:07,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:07:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:07:09,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:07:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 07:07:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:07:09,538 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 07:07:09,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:07:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:22 UTC)" (scheduled at 2022-11-28 07:07:12.901291+00:00) notificationworker stdout | 2022-11-28 07:07:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:07:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:15 UTC)" (scheduled at 2022-11-28 07:07:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:07:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:07:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:45 UTC)" (scheduled at 2022-11-28 07:07:15.911636+00:00) securityworker stdout | 2022-11-28 07:07:16,153 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:07:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:47 UTC)" (scheduled at 2022-11-28 07:07:17.016425+00:00) gcworker stdout | 2022-11-28 07:07:17,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:07:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:32 UTC)" (scheduled at 2022-11-28 07:07:22.901291+00:00) notificationworker stdout | 2022-11-28 07:07:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:07:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:53 UTC)" (scheduled at 2022-11-28 07:07:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:07:23,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:07:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:07:24,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:07:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.000) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:07:24,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:24,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:07:24,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:07:24,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:07:24,583 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) notificationworker stdout | 2022-11-28 07:07:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:42 UTC)" (scheduled at 2022-11-28 07:07:32.901291+00:00) notificationworker stdout | 2022-11-28 07:07:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:07:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:33 UTC)" (scheduled at 2022-11-28 07:07:33.026570+00:00) notificationworker stdout | 2022-11-28 07:07:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:07:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:33 UTC)" (scheduled at 2022-11-28 07:07:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:07:33,361 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:07:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:07 UTC)" (scheduled at 2022-11-28 07:07:37.716126+00:00) securityworker stdout | 2022-11-28 07:07:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:07:37,820 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:07:37,821 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:07:39,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:07:39,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:39,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:07:39,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:07:39,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:07:39,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 07:07:39,536 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:07:39,536 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) notificationworker stdout | 2022-11-28 07:07:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:52 UTC)" (scheduled at 2022-11-28 07:07:42.901291+00:00) notificationworker stdout | 2022-11-28 07:07:42,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:07:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:07:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:15 UTC)" (scheduled at 2022-11-28 07:07:45.911636+00:00) securityworker stdout | 2022-11-28 07:07:45,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:07:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:17 UTC)" (scheduled at 2022-11-28 07:07:47.016425+00:00) gcworker stdout | 2022-11-28 07:07:47,054 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:07:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:50 UTC)" (scheduled at 2022-11-28 07:07:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:07:50,165 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:07:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:51 UTC)" (scheduled at 2022-11-28 07:07:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:07:51,778 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:07:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:02 UTC)" (scheduled at 2022-11-28 07:07:52.901291+00:00) notificationworker stdout | 2022-11-28 07:07:52,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:07:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:23 UTC)" (scheduled at 2022-11-28 07:07:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:07:53,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:07:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:07:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:07:54,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:07:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:07:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:07:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 07:07:54,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:07:54,554 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:07:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:56 UTC)" (scheduled at 2022-11-28 07:07:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:07:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:07:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:57 UTC)" (scheduled at 2022-11-28 07:07:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:07:57,570 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:08:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:08:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:12 UTC)" (scheduled at 2022-11-28 07:08:02.901291+00:00) notificationworker stdout | 2022-11-28 07:08:02,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:08:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:03 UTC)" (scheduled at 2022-11-28 07:08:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:08:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:08:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:06 UTC)" (scheduled at 2022-11-28 07:08:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:08:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:08:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:37 UTC)" (scheduled at 2022-11-28 07:08:07.716126+00:00) securityworker stdout | 2022-11-28 07:08:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:08:07,771 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:08:07,772 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:08:09,486 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:08:09,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:08:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:08:09,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 07:08:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:08:09,560 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:08:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:22 UTC)" (scheduled at 2022-11-28 07:08:12.901291+00:00) notificationworker stdout | 2022-11-28 07:08:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:08:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:15 UTC)" (scheduled at 2022-11-28 07:08:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:08:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:08:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:45 UTC)" (scheduled at 2022-11-28 07:08:15.911636+00:00) securityworker stdout | 2022-11-28 07:08:15,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:08:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:47 UTC)" (scheduled at 2022-11-28 07:08:17.016425+00:00) gcworker stdout | 2022-11-28 07:08:17,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:08:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:32 UTC)" (scheduled at 2022-11-28 07:08:22.901291+00:00) notificationworker stdout | 2022-11-28 07:08:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:08:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:53 UTC)" (scheduled at 2022-11-28 07:08:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:08:23,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:08:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:08:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:08:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:08:24,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:24,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:08:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 07:08:24,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) gunicorn-web stdout | 2022-11-28 07:08:24,582 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:08:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:42 UTC)" (scheduled at 2022-11-28 07:08:32.901291+00:00) notificationworker stdout | 2022-11-28 07:08:32,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:08:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:33 UTC)" (scheduled at 2022-11-28 07:08:33.026570+00:00) notificationworker stdout | 2022-11-28 07:08:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:08:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:33 UTC)" (scheduled at 2022-11-28 07:08:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:08:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:08:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:07 UTC)" (scheduled at 2022-11-28 07:08:37.716126+00:00) securityworker stdout | 2022-11-28 07:08:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:08:37,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:08:37,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:08:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:13:38 UTC)" (scheduled at 2022-11-28 07:08:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:08:38,525 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:13:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:08:39,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:08:39,497 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:08:39,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:08:39,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:08:39,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:39,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:08:39,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 07:08:39,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:08:42,907 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:52 UTC)" (scheduled at 2022-11-28 07:08:42.901291+00:00) notificationworker stdout | 2022-11-28 07:08:42,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:08:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:08:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:15 UTC)" (scheduled at 2022-11-28 07:08:45.911636+00:00) securityworker stdout | 2022-11-28 07:08:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:08:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:17 UTC)" (scheduled at 2022-11-28 07:08:47.016425+00:00) gcworker stdout | 2022-11-28 07:08:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:08:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:13:49 UTC)" (scheduled at 2022-11-28 07:08:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:08:49,443 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:13:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:08:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:50 UTC)" (scheduled at 2022-11-28 07:08:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:08:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:08:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:51 UTC)" (scheduled at 2022-11-28 07:08:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:08:51,801 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:08:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:02 UTC)" (scheduled at 2022-11-28 07:08:52.901291+00:00) notificationworker stdout | 2022-11-28 07:08:52,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:08:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:23 UTC)" (scheduled at 2022-11-28 07:08:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:08:53,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:08:54,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:08:54,488 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-web stdout | 2022-11-28 07:08:54,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:08:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:08:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:08:54,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 07:08:54,580 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 07:08:54,592 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:08:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:56 UTC)" (scheduled at 2022-11-28 07:08:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:08:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:08:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:57 UTC)" (scheduled at 2022-11-28 07:08:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:08:57,545 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:09:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:09:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:12 UTC)" (scheduled at 2022-11-28 07:09:02.901291+00:00) notificationworker stdout | 2022-11-28 07:09:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:09:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:03 UTC)" (scheduled at 2022-11-28 07:09:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:09:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:09:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:06 UTC)" (scheduled at 2022-11-28 07:09:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:09:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:09:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:37 UTC)" (scheduled at 2022-11-28 07:09:07.716126+00:00) securityworker stdout | 2022-11-28 07:09:07,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:09:07,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:09:07,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:09:09,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:09:09,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:09:09,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:09:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:09:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:09:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:09:09,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:09:09,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) notificationworker stdout | 2022-11-28 07:09:12,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:22 UTC)" (scheduled at 2022-11-28 07:09:12.901291+00:00) notificationworker stdout | 2022-11-28 07:09:13,013 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:09:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:15 UTC)" (scheduled at 2022-11-28 07:09:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:09:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:09:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:45 UTC)" (scheduled at 2022-11-28 07:09:15.911636+00:00) securityworker stdout | 2022-11-28 07:09:15,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:09:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:47 UTC)" (scheduled at 2022-11-28 07:09:17.016425+00:00) gcworker stdout | 2022-11-28 07:09:17,109 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:09:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:32 UTC)" (scheduled at 2022-11-28 07:09:22.901291+00:00) notificationworker stdout | 2022-11-28 07:09:22,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:09:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:53 UTC)" (scheduled at 2022-11-28 07:09:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:09:23,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:09:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:09:24,517 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:09:24,517 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:09:24,546 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:09:24,548 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:09:24,550 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 07:09:24,557 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) gunicorn-web stdout | 2022-11-28 07:09:24,619 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) gunicorn-web stdout | 2022-11-28 07:09:24,629 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:09:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:42 UTC)" (scheduled at 2022-11-28 07:09:32.901291+00:00) notificationworker stdout | 2022-11-28 07:09:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:09:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:33 UTC)" (scheduled at 2022-11-28 07:09:33.026570+00:00) notificationworker stdout | 2022-11-28 07:09:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:09:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:33 UTC)" (scheduled at 2022-11-28 07:09:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:09:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:09:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:07 UTC)" (scheduled at 2022-11-28 07:09:37.716126+00:00) securityworker stdout | 2022-11-28 07:09:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:09:37,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:09:37,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:09:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:14:38 UTC)" (scheduled at 2022-11-28 07:09:38.024004+00:00) notificationworker stdout | 2022-11-28 07:09:38,079 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:14:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:09:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:09:39,493 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:09:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:09:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:09:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:09:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 07:09:39,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:09:39,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:09:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:52 UTC)" (scheduled at 2022-11-28 07:09:42.901291+00:00) notificationworker stdout | 2022-11-28 07:09:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:09:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:09:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:15 UTC)" (scheduled at 2022-11-28 07:09:45.911636+00:00) securityworker stdout | 2022-11-28 07:09:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:09:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:17 UTC)" (scheduled at 2022-11-28 07:09:47.016425+00:00) gcworker stdout | 2022-11-28 07:09:47,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:09:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:50 UTC)" (scheduled at 2022-11-28 07:09:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:09:50,183 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:09:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:51 UTC)" (scheduled at 2022-11-28 07:09:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:09:51,809 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:09:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:02 UTC)" (scheduled at 2022-11-28 07:09:52.901291+00:00) notificationworker stdout | 2022-11-28 07:09:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:09:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:23 UTC)" (scheduled at 2022-11-28 07:09:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:09:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:09:54,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:09:54,485 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 07:09:54,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:09:54,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:09:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:09:54,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:09:54,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 07:09:54,584 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:09:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:56 UTC)" (scheduled at 2022-11-28 07:09:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:09:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:09:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:57 UTC)" (scheduled at 2022-11-28 07:09:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:09:57,567 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:10:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:10:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:12 UTC)" (scheduled at 2022-11-28 07:10:02.901291+00:00) notificationworker stdout | 2022-11-28 07:10:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:10:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:03 UTC)" (scheduled at 2022-11-28 07:10:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:10:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:10:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:06 UTC)" (scheduled at 2022-11-28 07:10:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:10:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:10:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:37 UTC)" (scheduled at 2022-11-28 07:10:07.716126+00:00) securityworker stdout | 2022-11-28 07:10:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:10:07,764 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:10:07,764 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:10:09,486 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:10:09,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:10:09,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:10:09,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:10:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:10:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.072) gunicorn-web stdout | 2022-11-28 07:10:09,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:10:09,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:10:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:22 UTC)" (scheduled at 2022-11-28 07:10:12.901291+00:00) notificationworker stdout | 2022-11-28 07:10:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:10:15,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:15 UTC)" (scheduled at 2022-11-28 07:10:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:10:15,040 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:10:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:45 UTC)" (scheduled at 2022-11-28 07:10:15.911636+00:00) securityworker stdout | 2022-11-28 07:10:15,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:10:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:47 UTC)" (scheduled at 2022-11-28 07:10:17.016425+00:00) gcworker stdout | 2022-11-28 07:10:17,052 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:10:22,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:32 UTC)" (scheduled at 2022-11-28 07:10:22.901291+00:00) notificationworker stdout | 2022-11-28 07:10:22,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:10:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:53 UTC)" (scheduled at 2022-11-28 07:10:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:10:23,163 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:10:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:10:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.009) gunicorn-registry stdout | 2022-11-28 07:10:24,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:10:24,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:10:24,515 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:10:24,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:10:24,518 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:10:24,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:10:24,571 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) notificationworker stdout | 2022-11-28 07:10:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:42 UTC)" (scheduled at 2022-11-28 07:10:32.901291+00:00) notificationworker stdout | 2022-11-28 07:10:32,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:10:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:33 UTC)" (scheduled at 2022-11-28 07:10:33.026570+00:00) notificationworker stdout | 2022-11-28 07:10:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:10:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:33 UTC)" (scheduled at 2022-11-28 07:10:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:10:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:10:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:07 UTC)" (scheduled at 2022-11-28 07:10:37.716126+00:00) securityworker stdout | 2022-11-28 07:10:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:10:37,788 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:10:37,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.010) gunicorn-registry stdout | 2022-11-28 07:10:39,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:10:39,496 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:10:39,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:10:39,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 07:10:39,517 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:10:39,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.098) gunicorn-web stdout | 2022-11-28 07:10:39,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.104) gunicorn-web stdout | 2022-11-28 07:10:39,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:10:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:15:41 UTC)" (scheduled at 2022-11-28 07:10:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:10:41,273 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:15:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:10:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:52 UTC)" (scheduled at 2022-11-28 07:10:42.901291+00:00) notificationworker stdout | 2022-11-28 07:10:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:10:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:10:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:15 UTC)" (scheduled at 2022-11-28 07:10:45.911636+00:00) securityworker stdout | 2022-11-28 07:10:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:10:47,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:17 UTC)" (scheduled at 2022-11-28 07:10:47.016425+00:00) gcworker stdout | 2022-11-28 07:10:47,085 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:10:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:15:48 UTC)" (scheduled at 2022-11-28 07:10:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:10:48,087 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:15:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:10:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:50 UTC)" (scheduled at 2022-11-28 07:10:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:10:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:10:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:51 UTC)" (scheduled at 2022-11-28 07:10:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:10:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:10:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:02 UTC)" (scheduled at 2022-11-28 07:10:52.901291+00:00) notificationworker stdout | 2022-11-28 07:10:52,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:10:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:23 UTC)" (scheduled at 2022-11-28 07:10:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:10:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:10:54,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:10:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:10:54,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:10:54,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:10:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:10:54,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.159 118 0.159) gunicorn-web stdout | 2022-11-28 07:10:54,631 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.163 118 0.163) gunicorn-web stdout | 2022-11-28 07:10:54,635 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:10:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:56 UTC)" (scheduled at 2022-11-28 07:10:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:10:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:10:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:57 UTC)" (scheduled at 2022-11-28 07:10:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:10:57,596 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:11:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:11:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:12 UTC)" (scheduled at 2022-11-28 07:11:02.901291+00:00) notificationworker stdout | 2022-11-28 07:11:02,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:11:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:03 UTC)" (scheduled at 2022-11-28 07:11:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:11:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:11:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:06 UTC)" (scheduled at 2022-11-28 07:11:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:11:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:11:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:37 UTC)" (scheduled at 2022-11-28 07:11:07.716126+00:00) securityworker stdout | 2022-11-28 07:11:07,748 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:11:07,875 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:11:07,876 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:11:09,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:11:09,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:11:09,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:11:09,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:11:09,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:09,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 07:11:09,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:11:09,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 07:11:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:22 UTC)" (scheduled at 2022-11-28 07:11:12.901291+00:00) notificationworker stdout | 2022-11-28 07:11:12,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:11:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:15 UTC)" (scheduled at 2022-11-28 07:11:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:11:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:11:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:45 UTC)" (scheduled at 2022-11-28 07:11:15.911636+00:00) securityworker stdout | 2022-11-28 07:11:16,020 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:11:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:47 UTC)" (scheduled at 2022-11-28 07:11:17.016425+00:00) gcworker stdout | 2022-11-28 07:11:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:11:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:32 UTC)" (scheduled at 2022-11-28 07:11:22.901291+00:00) notificationworker stdout | 2022-11-28 07:11:22,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:11:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:53 UTC)" (scheduled at 2022-11-28 07:11:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:11:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:11:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:11:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:11:24,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:11:24,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:11:24,513 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:24,513 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:11:24,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:24,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 07:11:24,571 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:11:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:42 UTC)" (scheduled at 2022-11-28 07:11:32.901291+00:00) notificationworker stdout | 2022-11-28 07:11:32,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:11:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:33 UTC)" (scheduled at 2022-11-28 07:11:33.026570+00:00) notificationworker stdout | 2022-11-28 07:11:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:11:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:33 UTC)" (scheduled at 2022-11-28 07:11:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:11:33,346 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:11:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:07 UTC)" (scheduled at 2022-11-28 07:11:37.716126+00:00) securityworker stdout | 2022-11-28 07:11:37,925 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:11:38,116 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:11:38,117 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:11:39,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:11:39,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:11:39,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:11:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:11:39,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:11:39,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:11:39,551 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) notificationworker stdout | 2022-11-28 07:11:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:52 UTC)" (scheduled at 2022-11-28 07:11:42.901291+00:00) notificationworker stdout | 2022-11-28 07:11:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:11:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:11:45,916 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:15 UTC)" (scheduled at 2022-11-28 07:11:45.911636+00:00) securityworker stdout | 2022-11-28 07:11:45,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:11:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:17 UTC)" (scheduled at 2022-11-28 07:11:47.016425+00:00) gcworker stdout | 2022-11-28 07:11:47,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:11:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:50 UTC)" (scheduled at 2022-11-28 07:11:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:11:50,183 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:11:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:51 UTC)" (scheduled at 2022-11-28 07:11:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:11:51,793 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:11:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:02 UTC)" (scheduled at 2022-11-28 07:11:52.901291+00:00) notificationworker stdout | 2022-11-28 07:11:52,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:11:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:23 UTC)" (scheduled at 2022-11-28 07:11:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:11:53,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:11:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 07:11:54,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:11:54,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:11:54,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:11:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:11:54,576 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:11:54,576 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) securityscanningnotificationworker stdout | 2022-11-28 07:11:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:56 UTC)" (scheduled at 2022-11-28 07:11:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:11:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:11:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:57 UTC)" (scheduled at 2022-11-28 07:11:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:11:57,646 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:12:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:12:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:12 UTC)" (scheduled at 2022-11-28 07:12:02.901291+00:00) notificationworker stdout | 2022-11-28 07:12:02,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:12:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:03 UTC)" (scheduled at 2022-11-28 07:12:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:12:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:12:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:06 UTC)" (scheduled at 2022-11-28 07:12:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:12:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:12:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:37 UTC)" (scheduled at 2022-11-28 07:12:07.716126+00:00) securityworker stdout | 2022-11-28 07:12:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:12:07,754 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:12:07,755 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:12:09,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:12:09,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:12:09,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:09,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:12:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:09,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:12:09,527 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:12:09,527 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.055 118 0.055) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) notificationworker stdout | 2022-11-28 07:12:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:22 UTC)" (scheduled at 2022-11-28 07:12:12.901291+00:00) notificationworker stdout | 2022-11-28 07:12:12,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:12:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:15 UTC)" (scheduled at 2022-11-28 07:12:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:12:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:12:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:45 UTC)" (scheduled at 2022-11-28 07:12:15.911636+00:00) securityworker stdout | 2022-11-28 07:12:15,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:12:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:47 UTC)" (scheduled at 2022-11-28 07:12:17.016425+00:00) gcworker stdout | 2022-11-28 07:12:17,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:12:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:32 UTC)" (scheduled at 2022-11-28 07:12:22.901291+00:00) notificationworker stdout | 2022-11-28 07:12:22,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:12:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:53 UTC)" (scheduled at 2022-11-28 07:12:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:12:23,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:12:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:12:24,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:12:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:12:24,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:24,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:12:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:12:24,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:12:24,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 07:12:24,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 07:12:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:42 UTC)" (scheduled at 2022-11-28 07:12:32.901291+00:00) notificationworker stdout | 2022-11-28 07:12:32,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:12:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:33 UTC)" (scheduled at 2022-11-28 07:12:33.026570+00:00) notificationworker stdout | 2022-11-28 07:12:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:12:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:33 UTC)" (scheduled at 2022-11-28 07:12:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:12:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:12:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:07 UTC)" (scheduled at 2022-11-28 07:12:37.716126+00:00) securityworker stdout | 2022-11-28 07:12:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:12:37,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:12:37,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:12:39,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:12:39,495 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:12:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:12:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:12:39,546 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 07:12:39,550 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:12:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:52 UTC)" (scheduled at 2022-11-28 07:12:42.901291+00:00) notificationworker stdout | 2022-11-28 07:12:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:12:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:12:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:15 UTC)" (scheduled at 2022-11-28 07:12:45.911636+00:00) securityworker stdout | 2022-11-28 07:12:46,025 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:12:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:17 UTC)" (scheduled at 2022-11-28 07:12:47.016425+00:00) gcworker stdout | 2022-11-28 07:12:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:12:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:50 UTC)" (scheduled at 2022-11-28 07:12:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:12:50,256 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:12:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:51 UTC)" (scheduled at 2022-11-28 07:12:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:12:51,822 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:12:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:02 UTC)" (scheduled at 2022-11-28 07:12:52.901291+00:00) notificationworker stdout | 2022-11-28 07:12:52,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:12:53,118 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:23 UTC)" (scheduled at 2022-11-28 07:12:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:12:53,214 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 07:12:54,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:12:54,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:12:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:12:54,619 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:12:54,622 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.187 118 0.187) gunicorn-web stdout | 2022-11-28 07:12:54,661 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.206 118 0.206) gunicorn-web stdout | 2022-11-28 07:12:54,683 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:12:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:56 UTC)" (scheduled at 2022-11-28 07:12:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:12:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:12:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:57 UTC)" (scheduled at 2022-11-28 07:12:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:12:57,607 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:13:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:13:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:12 UTC)" (scheduled at 2022-11-28 07:13:02.901291+00:00) notificationworker stdout | 2022-11-28 07:13:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:13:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:03 UTC)" (scheduled at 2022-11-28 07:13:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:13:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:13:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:06 UTC)" (scheduled at 2022-11-28 07:13:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:13:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:13:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:37 UTC)" (scheduled at 2022-11-28 07:13:07.716126+00:00) securityworker stdout | 2022-11-28 07:13:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:13:07,944 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:13:07,946 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:13:09,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:13:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:09,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:13:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:13:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:13:09,585 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 07:13:09,587 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.200 118 0.200) gunicorn-web stdout | 2022-11-28 07:13:09,673 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:13:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:22 UTC)" (scheduled at 2022-11-28 07:13:12.901291+00:00) notificationworker stdout | 2022-11-28 07:13:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:13:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:15 UTC)" (scheduled at 2022-11-28 07:13:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:13:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:13:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:45 UTC)" (scheduled at 2022-11-28 07:13:15.911636+00:00) securityworker stdout | 2022-11-28 07:13:15,996 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:13:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:47 UTC)" (scheduled at 2022-11-28 07:13:17.016425+00:00) gcworker stdout | 2022-11-28 07:13:17,138 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:13:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:32 UTC)" (scheduled at 2022-11-28 07:13:22.901291+00:00) notificationworker stdout | 2022-11-28 07:13:22,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:13:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:53 UTC)" (scheduled at 2022-11-28 07:13:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:13:23,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:13:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:13:24,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:13:24,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:13:24,492 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:24,494 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:13:24,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:24,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 07:13:24,548 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:13:24,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 07:13:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:42 UTC)" (scheduled at 2022-11-28 07:13:32.901291+00:00) notificationworker stdout | 2022-11-28 07:13:32,974 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:13:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:33 UTC)" (scheduled at 2022-11-28 07:13:33.026570+00:00) notificationworker stdout | 2022-11-28 07:13:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:13:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:33 UTC)" (scheduled at 2022-11-28 07:13:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:13:33,373 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:13:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:07 UTC)" (scheduled at 2022-11-28 07:13:37.716126+00:00) securityworker stdout | 2022-11-28 07:13:37,744 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:13:37,892 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:13:37,893 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:13:38,421 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:18:38 UTC)" (scheduled at 2022-11-28 07:13:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:13:38,685 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:18:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:13:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:13:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 07:13:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:39,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:13:39,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:39,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.193 118 0.193) gunicorn-web stdout | 2022-11-28 07:13:39,670 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.275 118 0.275) gunicorn-web stdout | 2022-11-28 07:13:39,753 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:13:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:52 UTC)" (scheduled at 2022-11-28 07:13:42.901291+00:00) notificationworker stdout | 2022-11-28 07:13:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:13:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:13:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:15 UTC)" (scheduled at 2022-11-28 07:13:45.911636+00:00) securityworker stdout | 2022-11-28 07:13:45,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:13:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:17 UTC)" (scheduled at 2022-11-28 07:13:47.016425+00:00) gcworker stdout | 2022-11-28 07:13:47,265 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:13:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:18:49 UTC)" (scheduled at 2022-11-28 07:13:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:13:49,469 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:18:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:13:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:50 UTC)" (scheduled at 2022-11-28 07:13:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:13:50,202 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:13:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:51 UTC)" (scheduled at 2022-11-28 07:13:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:13:51,797 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:13:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:02 UTC)" (scheduled at 2022-11-28 07:13:52.901291+00:00) notificationworker stdout | 2022-11-28 07:13:52,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:13:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:23 UTC)" (scheduled at 2022-11-28 07:13:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:13:53,171 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:13:54,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:13:54,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:13:54,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:13:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:13:54,706 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:13:54,765 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.292 118 0.292) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.461 118 0.461) gunicorn-web stdout | 2022-11-28 07:13:54,933 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:13:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:56 UTC)" (scheduled at 2022-11-28 07:13:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:13:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:13:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:57 UTC)" (scheduled at 2022-11-28 07:13:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:13:57,666 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:14:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:14:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:12 UTC)" (scheduled at 2022-11-28 07:14:02.901291+00:00) notificationworker stdout | 2022-11-28 07:14:03,012 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:14:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:03 UTC)" (scheduled at 2022-11-28 07:14:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:14:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:14:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:06 UTC)" (scheduled at 2022-11-28 07:14:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:14:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:14:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:37 UTC)" (scheduled at 2022-11-28 07:14:07.716126+00:00) securityworker stdout | 2022-11-28 07:14:08,024 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:14:08,231 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:14:08,231 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:14:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:14:09,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:09,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:14:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:14:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:14:09,642 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.169 118 0.169) gunicorn-web stdout | 2022-11-28 07:14:09,669 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.196 118 0.196) notificationworker stdout | 2022-11-28 07:14:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:22 UTC)" (scheduled at 2022-11-28 07:14:12.901291+00:00) notificationworker stdout | 2022-11-28 07:14:13,022 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:14:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:15 UTC)" (scheduled at 2022-11-28 07:14:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:14:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:14:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:45 UTC)" (scheduled at 2022-11-28 07:14:15.911636+00:00) securityworker stdout | 2022-11-28 07:14:16,087 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:14:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:47 UTC)" (scheduled at 2022-11-28 07:14:17.016425+00:00) gcworker stdout | 2022-11-28 07:14:17,129 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:14:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:32 UTC)" (scheduled at 2022-11-28 07:14:22.901291+00:00) notificationworker stdout | 2022-11-28 07:14:23,001 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:14:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:53 UTC)" (scheduled at 2022-11-28 07:14:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:14:23,189 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:14:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:14:24,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:14:24,496 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:14:24,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:14:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:14:24,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:24,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.219 118 0.219) gunicorn-web stdout | 2022-11-28 07:14:24,692 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:14:24,738 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.266 118 0.266) notificationworker stdout | 2022-11-28 07:14:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:42 UTC)" (scheduled at 2022-11-28 07:14:32.901291+00:00) notificationworker stdout | 2022-11-28 07:14:32,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:14:33,032 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:33 UTC)" (scheduled at 2022-11-28 07:14:33.026570+00:00) notificationworker stdout | 2022-11-28 07:14:33,033 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:14:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:33 UTC)" (scheduled at 2022-11-28 07:14:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:14:33,374 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:14:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:07 UTC)" (scheduled at 2022-11-28 07:14:37.716126+00:00) securityworker stdout | 2022-11-28 07:14:37,756 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:14:37,841 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:14:37,842 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:14:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:19:38 UTC)" (scheduled at 2022-11-28 07:14:38.024004+00:00) notificationworker stdout | 2022-11-28 07:14:38,128 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:19:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:14:39,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:14:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:14:39,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:39,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:14:39,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:39,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:14:39,569 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:14:39,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.102) notificationworker stdout | 2022-11-28 07:14:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:52 UTC)" (scheduled at 2022-11-28 07:14:42.901291+00:00) notificationworker stdout | 2022-11-28 07:14:42,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:14:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:14:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:15 UTC)" (scheduled at 2022-11-28 07:14:45.911636+00:00) securityworker stdout | 2022-11-28 07:14:45,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:14:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:17 UTC)" (scheduled at 2022-11-28 07:14:47.016425+00:00) gcworker stdout | 2022-11-28 07:14:47,083 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:14:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:50 UTC)" (scheduled at 2022-11-28 07:14:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:14:50,203 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:14:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:51 UTC)" (scheduled at 2022-11-28 07:14:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:14:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:14:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:02 UTC)" (scheduled at 2022-11-28 07:14:52.901291+00:00) notificationworker stdout | 2022-11-28 07:14:52,993 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:14:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:23 UTC)" (scheduled at 2022-11-28 07:14:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:14:53,182 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:14:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:14:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:14:54,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:14:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:14:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:14:54,611 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.134) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 07:14:54,620 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:14:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:56 UTC)" (scheduled at 2022-11-28 07:14:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:14:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:14:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:57 UTC)" (scheduled at 2022-11-28 07:14:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:14:57,605 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:15:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:12 UTC)" (scheduled at 2022-11-28 07:15:02.901291+00:00) notificationworker stdout | 2022-11-28 07:15:02,992 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:15:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:03 UTC)" (scheduled at 2022-11-28 07:15:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:15:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:15:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:06 UTC)" (scheduled at 2022-11-28 07:15:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:15:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:15:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:37 UTC)" (scheduled at 2022-11-28 07:15:07.716126+00:00) securityworker stdout | 2022-11-28 07:15:07,750 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:15:07,870 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:15:07,871 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:15:09,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:15:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:09,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:15:09,494 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:15:09,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) gunicorn-web stdout | 2022-11-28 07:15:09,582 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:15:09,594 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.121 118 0.121) globalpromstats stdout | 2022-11-28 07:15:12,518 [66] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 08:15:12 UTC)" (scheduled at 2022-11-28 07:15:12.517266+00:00) globalpromstats stdout | 2022-11-28 07:15:12,523 [66] [INFO] [redis_lock.acquire] Got lock for 'lock:GLOBAL_PROM_STATS'. globalpromstats stdout | 2022-11-28 07:15:12,671 [66] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 08:15:12 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:22 UTC)" (scheduled at 2022-11-28 07:15:12.901291+00:00) notificationworker stdout | 2022-11-28 07:15:12,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:15:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:15 UTC)" (scheduled at 2022-11-28 07:15:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:15:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:15:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:45 UTC)" (scheduled at 2022-11-28 07:15:15.911636+00:00) securityworker stdout | 2022-11-28 07:15:16,012 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:15:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:47 UTC)" (scheduled at 2022-11-28 07:15:17.016425+00:00) gcworker stdout | 2022-11-28 07:15:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:22,910 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:32 UTC)" (scheduled at 2022-11-28 07:15:22.901291+00:00) notificationworker stdout | 2022-11-28 07:15:22,992 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:15:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:53 UTC)" (scheduled at 2022-11-28 07:15:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:15:23,220 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:15:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:15:24,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:15:24,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-web stdout | 2022-11-28 07:15:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:15:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:15:24,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.007) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 07:15:24,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) gunicorn-web stdout | 2022-11-28 07:15:24,594 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:15:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:42 UTC)" (scheduled at 2022-11-28 07:15:32.901291+00:00) notificationworker stdout | 2022-11-28 07:15:32,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:33 UTC)" (scheduled at 2022-11-28 07:15:33.026570+00:00) notificationworker stdout | 2022-11-28 07:15:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:15:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:33 UTC)" (scheduled at 2022-11-28 07:15:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:15:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:15:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:07 UTC)" (scheduled at 2022-11-28 07:15:37.716126+00:00) securityworker stdout | 2022-11-28 07:15:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:15:37,824 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:15:37,825 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:15:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:15:39,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:15:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:39,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:15:39,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:39,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.168 118 0.168) gunicorn-web stdout | 2022-11-28 07:15:39,642 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.192 118 0.192) gunicorn-web stdout | 2022-11-28 07:15:39,666 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:15:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:20:41 UTC)" (scheduled at 2022-11-28 07:15:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:15:41,289 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:20:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:52 UTC)" (scheduled at 2022-11-28 07:15:42.901291+00:00) notificationworker stdout | 2022-11-28 07:15:42,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:15:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:15:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:15 UTC)" (scheduled at 2022-11-28 07:15:45.911636+00:00) securityworker stdout | 2022-11-28 07:15:46,063 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:15:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:17 UTC)" (scheduled at 2022-11-28 07:15:47.016425+00:00) gcworker stdout | 2022-11-28 07:15:47,085 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:15:48,042 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:20:48 UTC)" (scheduled at 2022-11-28 07:15:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:15:48,111 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:20:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:15:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:50 UTC)" (scheduled at 2022-11-28 07:15:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:15:50,176 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:15:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:51 UTC)" (scheduled at 2022-11-28 07:15:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:15:51,783 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:15:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:02 UTC)" (scheduled at 2022-11-28 07:15:52.901291+00:00) notificationworker stdout | 2022-11-28 07:15:53,016 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:15:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:23 UTC)" (scheduled at 2022-11-28 07:15:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:15:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:15:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:15:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:15:54,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:15:54,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:15:54,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:15:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.165 118 0.165) gunicorn-web stdout | 2022-11-28 07:15:54,639 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.173 118 0.173) gunicorn-web stdout | 2022-11-28 07:15:54,646 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:15:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:56 UTC)" (scheduled at 2022-11-28 07:15:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:15:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:15:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:57 UTC)" (scheduled at 2022-11-28 07:15:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:15:57,642 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:16:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:16:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:12 UTC)" (scheduled at 2022-11-28 07:16:02.901291+00:00) notificationworker stdout | 2022-11-28 07:16:02,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:16:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:03 UTC)" (scheduled at 2022-11-28 07:16:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:16:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:16:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:06 UTC)" (scheduled at 2022-11-28 07:16:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:16:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:16:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:37 UTC)" (scheduled at 2022-11-28 07:16:07.716126+00:00) securityworker stdout | 2022-11-28 07:16:07,756 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:16:07,939 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:16:07,940 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:16:09,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:16:09,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 07:16:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:09,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:16:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 07:16:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 07:16:09,576 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:16:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:22 UTC)" (scheduled at 2022-11-28 07:16:12.901291+00:00) notificationworker stdout | 2022-11-28 07:16:12,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:16:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:15 UTC)" (scheduled at 2022-11-28 07:16:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:16:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:16:15,933 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:45 UTC)" (scheduled at 2022-11-28 07:16:15.911636+00:00) securityworker stdout | 2022-11-28 07:16:16,025 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:16:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:47 UTC)" (scheduled at 2022-11-28 07:16:17.016425+00:00) gcworker stdout | 2022-11-28 07:16:17,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:16:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:32 UTC)" (scheduled at 2022-11-28 07:16:22.901291+00:00) notificationworker stdout | 2022-11-28 07:16:22,994 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:16:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:53 UTC)" (scheduled at 2022-11-28 07:16:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:16:23,293 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:16:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:16:24,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.003) gunicorn-registry stdout | 2022-11-28 07:16:24,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:16:24,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:24,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:16:24,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:16:24,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:16:24,596 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.120) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.135) gunicorn-web stdout | 2022-11-28 07:16:24,611 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:16:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:42 UTC)" (scheduled at 2022-11-28 07:16:32.901291+00:00) notificationworker stdout | 2022-11-28 07:16:32,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:16:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:33 UTC)" (scheduled at 2022-11-28 07:16:33.026570+00:00) notificationworker stdout | 2022-11-28 07:16:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:16:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:33 UTC)" (scheduled at 2022-11-28 07:16:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:16:33,347 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:16:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:07 UTC)" (scheduled at 2022-11-28 07:16:37.716126+00:00) securityworker stdout | 2022-11-28 07:16:37,755 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:16:37,816 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:16:37,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 07:16:39,495 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:16:39,496 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:16:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:39,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:16:39,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:16:39,523 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) gunicorn-web stdout | 2022-11-28 07:16:39,625 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.164 118 0.164) gunicorn-web stdout | 2022-11-28 07:16:39,637 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:16:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:52 UTC)" (scheduled at 2022-11-28 07:16:42.901291+00:00) notificationworker stdout | 2022-11-28 07:16:42,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:16:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:16:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:15 UTC)" (scheduled at 2022-11-28 07:16:45.911636+00:00) securityworker stdout | 2022-11-28 07:16:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:16:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:17 UTC)" (scheduled at 2022-11-28 07:16:47.016425+00:00) gcworker stdout | 2022-11-28 07:16:47,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:16:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:50 UTC)" (scheduled at 2022-11-28 07:16:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:16:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:16:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:51 UTC)" (scheduled at 2022-11-28 07:16:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:16:51,760 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:16:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:02 UTC)" (scheduled at 2022-11-28 07:16:52.901291+00:00) notificationworker stdout | 2022-11-28 07:16:52,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:16:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:23 UTC)" (scheduled at 2022-11-28 07:16:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:16:53,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:16:54,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:16:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:16:54,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:54,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:16:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:16:54,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 07:16:54,540 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 07:16:54,546 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:16:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:56 UTC)" (scheduled at 2022-11-28 07:16:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:16:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:16:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:57 UTC)" (scheduled at 2022-11-28 07:16:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:16:57,695 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:17:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:17:02,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:12 UTC)" (scheduled at 2022-11-28 07:17:02.901291+00:00) notificationworker stdout | 2022-11-28 07:17:03,012 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:17:03,410 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:03 UTC)" (scheduled at 2022-11-28 07:17:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:17:03,411 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:17:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:06 UTC)" (scheduled at 2022-11-28 07:17:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:17:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:17:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:37 UTC)" (scheduled at 2022-11-28 07:17:07.716126+00:00) securityworker stdout | 2022-11-28 07:17:07,764 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:17:07,986 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:17:07,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:17:09,487 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:17:09,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:09,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:09,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:17:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:17:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 07:17:09,583 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:17:09,616 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.143 118 0.143) notificationworker stdout | 2022-11-28 07:17:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:22 UTC)" (scheduled at 2022-11-28 07:17:12.901291+00:00) notificationworker stdout | 2022-11-28 07:17:13,040 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:17:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:15 UTC)" (scheduled at 2022-11-28 07:17:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:17:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:17:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:45 UTC)" (scheduled at 2022-11-28 07:17:15.911636+00:00) securityworker stdout | 2022-11-28 07:17:16,049 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:17:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:47 UTC)" (scheduled at 2022-11-28 07:17:17.016425+00:00) gcworker stdout | 2022-11-28 07:17:17,159 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:17:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:32 UTC)" (scheduled at 2022-11-28 07:17:22.901291+00:00) notificationworker stdout | 2022-11-28 07:17:22,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:17:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:53 UTC)" (scheduled at 2022-11-28 07:17:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:17:23,184 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:17:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:17:24,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:17:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:24,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:24,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:17:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:24,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.155 118 0.156) gunicorn-web stdout | 2022-11-28 07:17:24,629 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.163) gunicorn-web stdout | 2022-11-28 07:17:24,636 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:17:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:42 UTC)" (scheduled at 2022-11-28 07:17:32.901291+00:00) notificationworker stdout | 2022-11-28 07:17:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:33 UTC)" (scheduled at 2022-11-28 07:17:33.026570+00:00) notificationworker stdout | 2022-11-28 07:17:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:17:33,090 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:17:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:33 UTC)" (scheduled at 2022-11-28 07:17:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:17:33,401 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:17:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:07 UTC)" (scheduled at 2022-11-28 07:17:37.716126+00:00) securityworker stdout | 2022-11-28 07:17:37,754 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:17:37,826 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:17:37,827 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:17:39,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 07:17:39,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:39,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:39,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) gunicorn-web stdout | 2022-11-28 07:17:39,585 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.116) gunicorn-web stdout | 2022-11-28 07:17:39,589 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:17:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:52 UTC)" (scheduled at 2022-11-28 07:17:42.901291+00:00) notificationworker stdout | 2022-11-28 07:17:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:17:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:17:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:15 UTC)" (scheduled at 2022-11-28 07:17:45.911636+00:00) securityworker stdout | 2022-11-28 07:17:45,967 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:17:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:17 UTC)" (scheduled at 2022-11-28 07:17:47.016425+00:00) gcworker stdout | 2022-11-28 07:17:47,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:17:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:50 UTC)" (scheduled at 2022-11-28 07:17:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:17:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:17:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:51 UTC)" (scheduled at 2022-11-28 07:17:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:17:51,775 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:17:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:02 UTC)" (scheduled at 2022-11-28 07:17:52.901291+00:00) notificationworker stdout | 2022-11-28 07:17:52,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:17:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:23 UTC)" (scheduled at 2022-11-28 07:17:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:17:53,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:17:54,494 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 07:17:54,498 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:54,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:54,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:17:54,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:17:54,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) gunicorn-web stdout | 2022-11-28 07:17:54,598 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:17:54,635 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.163 118 0.163) securityscanningnotificationworker stdout | 2022-11-28 07:17:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:56 UTC)" (scheduled at 2022-11-28 07:17:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:17:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:17:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:57 UTC)" (scheduled at 2022-11-28 07:17:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:17:57,575 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:18:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:18:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:12 UTC)" (scheduled at 2022-11-28 07:18:02.901291+00:00) notificationworker stdout | 2022-11-28 07:18:02,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:18:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:03 UTC)" (scheduled at 2022-11-28 07:18:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:18:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:18:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:06 UTC)" (scheduled at 2022-11-28 07:18:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:18:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:18:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:37 UTC)" (scheduled at 2022-11-28 07:18:07.716126+00:00) securityworker stdout | 2022-11-28 07:18:07,737 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:18:07,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:18:07,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:18:09,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:18:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:18:09,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:09,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:18:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 07:18:09,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:18:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:18:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:22 UTC)" (scheduled at 2022-11-28 07:18:12.901291+00:00) notificationworker stdout | 2022-11-28 07:18:12,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:18:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:15 UTC)" (scheduled at 2022-11-28 07:18:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:18:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:18:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:45 UTC)" (scheduled at 2022-11-28 07:18:15.911636+00:00) securityworker stdout | 2022-11-28 07:18:15,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:18:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:47 UTC)" (scheduled at 2022-11-28 07:18:17.016425+00:00) gcworker stdout | 2022-11-28 07:18:17,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:18:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:32 UTC)" (scheduled at 2022-11-28 07:18:22.901291+00:00) notificationworker stdout | 2022-11-28 07:18:22,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:18:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:53 UTC)" (scheduled at 2022-11-28 07:18:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:18:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:18:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:18:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:18:24,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:18:24,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:24,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:18:24,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:24,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:18:24,573 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) gunicorn-web stdout | 2022-11-28 07:18:24,594 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:18:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:42 UTC)" (scheduled at 2022-11-28 07:18:32.901291+00:00) notificationworker stdout | 2022-11-28 07:18:32,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:18:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:33 UTC)" (scheduled at 2022-11-28 07:18:33.026570+00:00) notificationworker stdout | 2022-11-28 07:18:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:18:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:33 UTC)" (scheduled at 2022-11-28 07:18:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:18:33,379 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:18:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:07 UTC)" (scheduled at 2022-11-28 07:18:37.716126+00:00) securityworker stdout | 2022-11-28 07:18:37,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:18:37,816 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:18:37,817 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:18:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:23:38 UTC)" (scheduled at 2022-11-28 07:18:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:18:38,477 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:23:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:18:39,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:18:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 07:18:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:18:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:39,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:18:39,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 07:18:39,564 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 07:18:39,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:18:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:52 UTC)" (scheduled at 2022-11-28 07:18:42.901291+00:00) notificationworker stdout | 2022-11-28 07:18:42,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:18:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:18:45,920 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:15 UTC)" (scheduled at 2022-11-28 07:18:45.911636+00:00) securityworker stdout | 2022-11-28 07:18:45,998 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:18:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:17 UTC)" (scheduled at 2022-11-28 07:18:47.016425+00:00) gcworker stdout | 2022-11-28 07:18:47,101 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:18:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:23:49 UTC)" (scheduled at 2022-11-28 07:18:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:18:49,482 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:23:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:18:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:50 UTC)" (scheduled at 2022-11-28 07:18:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:18:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:18:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:51 UTC)" (scheduled at 2022-11-28 07:18:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:18:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:18:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:02 UTC)" (scheduled at 2022-11-28 07:18:52.901291+00:00) notificationworker stdout | 2022-11-28 07:18:52,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:18:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:23 UTC)" (scheduled at 2022-11-28 07:18:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:18:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:18:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:18:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:18:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:54,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:18:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:18:54,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:18:54,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.133 118 0.133) gunicorn-web stdout | 2022-11-28 07:18:54,604 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:18:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:56 UTC)" (scheduled at 2022-11-28 07:18:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:18:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:18:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:57 UTC)" (scheduled at 2022-11-28 07:18:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:18:57,588 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:19:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:19:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:12 UTC)" (scheduled at 2022-11-28 07:19:02.901291+00:00) notificationworker stdout | 2022-11-28 07:19:02,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:19:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:03 UTC)" (scheduled at 2022-11-28 07:19:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:19:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:19:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:06 UTC)" (scheduled at 2022-11-28 07:19:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:19:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:19:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:37 UTC)" (scheduled at 2022-11-28 07:19:07.716126+00:00) securityworker stdout | 2022-11-28 07:19:07,915 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:19:08,135 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:19:08,136 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.008) gunicorn-registry stdout | 2022-11-28 07:19:09,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:19:09,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:19:09,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:19:09,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.078) gunicorn-web stdout | 2022-11-28 07:19:09,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:19:09,554 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) notificationworker stdout | 2022-11-28 07:19:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:22 UTC)" (scheduled at 2022-11-28 07:19:12.901291+00:00) notificationworker stdout | 2022-11-28 07:19:12,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:19:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:15 UTC)" (scheduled at 2022-11-28 07:19:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:19:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:19:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:45 UTC)" (scheduled at 2022-11-28 07:19:15.911636+00:00) securityworker stdout | 2022-11-28 07:19:15,982 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:19:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:47 UTC)" (scheduled at 2022-11-28 07:19:17.016425+00:00) gcworker stdout | 2022-11-28 07:19:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:19:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:32 UTC)" (scheduled at 2022-11-28 07:19:22.901291+00:00) notificationworker stdout | 2022-11-28 07:19:22,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:19:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:53 UTC)" (scheduled at 2022-11-28 07:19:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:19:23,196 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:19:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:19:24,485 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:24,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:24,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-registry stdout | 2022-11-28 07:19:24,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:24,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:19:24,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 07:19:24,566 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:19:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:42 UTC)" (scheduled at 2022-11-28 07:19:32.901291+00:00) notificationworker stdout | 2022-11-28 07:19:32,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:19:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:33 UTC)" (scheduled at 2022-11-28 07:19:33.026570+00:00) notificationworker stdout | 2022-11-28 07:19:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:19:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:33 UTC)" (scheduled at 2022-11-28 07:19:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:19:33,376 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:19:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:07 UTC)" (scheduled at 2022-11-28 07:19:37.716126+00:00) securityworker stdout | 2022-11-28 07:19:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:19:37,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:19:37,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:19:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:24:38 UTC)" (scheduled at 2022-11-28 07:19:38.024004+00:00) notificationworker stdout | 2022-11-28 07:19:38,106 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:24:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:19:39,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:19:39,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:19:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:39,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:19:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:39,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 07:19:39,574 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) gunicorn-web stdout | 2022-11-28 07:19:39,604 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:19:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:52 UTC)" (scheduled at 2022-11-28 07:19:42.901291+00:00) notificationworker stdout | 2022-11-28 07:19:42,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:19:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:19:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:15 UTC)" (scheduled at 2022-11-28 07:19:45.911636+00:00) securityworker stdout | 2022-11-28 07:19:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:19:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:17 UTC)" (scheduled at 2022-11-28 07:19:47.016425+00:00) gcworker stdout | 2022-11-28 07:19:47,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:19:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:50 UTC)" (scheduled at 2022-11-28 07:19:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:19:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:19:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:51 UTC)" (scheduled at 2022-11-28 07:19:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:19:51,781 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:19:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:02 UTC)" (scheduled at 2022-11-28 07:19:52.901291+00:00) notificationworker stdout | 2022-11-28 07:19:52,975 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:19:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:23 UTC)" (scheduled at 2022-11-28 07:19:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:19:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:19:54,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:19:54,487 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:19:54,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:54,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:19:54,494 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:19:54,494 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.139 118 0.139) gunicorn-web stdout | 2022-11-28 07:19:54,610 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:19:54,616 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) securityscanningnotificationworker stdout | 2022-11-28 07:19:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:56 UTC)" (scheduled at 2022-11-28 07:19:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:19:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:19:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:57 UTC)" (scheduled at 2022-11-28 07:19:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:19:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:20:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:20:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:12 UTC)" (scheduled at 2022-11-28 07:20:02.901291+00:00) notificationworker stdout | 2022-11-28 07:20:02,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:20:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:03 UTC)" (scheduled at 2022-11-28 07:20:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:20:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:20:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:06 UTC)" (scheduled at 2022-11-28 07:20:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:20:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:20:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:37 UTC)" (scheduled at 2022-11-28 07:20:07.716126+00:00) securityworker stdout | 2022-11-28 07:20:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:20:07,820 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:20:07,821 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:20:09,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:20:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:09,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:20:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:20:09,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:20:09,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 07:20:09,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:20:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:22 UTC)" (scheduled at 2022-11-28 07:20:12.901291+00:00) notificationworker stdout | 2022-11-28 07:20:12,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:20:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:15 UTC)" (scheduled at 2022-11-28 07:20:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:20:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:20:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:45 UTC)" (scheduled at 2022-11-28 07:20:15.911636+00:00) securityworker stdout | 2022-11-28 07:20:16,072 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:20:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:47 UTC)" (scheduled at 2022-11-28 07:20:17.016425+00:00) gcworker stdout | 2022-11-28 07:20:17,141 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:20:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:32 UTC)" (scheduled at 2022-11-28 07:20:22.901291+00:00) notificationworker stdout | 2022-11-28 07:20:23,010 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:20:23,120 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:53 UTC)" (scheduled at 2022-11-28 07:20:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:20:23,204 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:20:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:20:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:20:24,502 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:24,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:20:24,517 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:20:24,520 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:20:24,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 07:20:24,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:20:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:42 UTC)" (scheduled at 2022-11-28 07:20:32.901291+00:00) notificationworker stdout | 2022-11-28 07:20:32,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:20:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:33 UTC)" (scheduled at 2022-11-28 07:20:33.026570+00:00) notificationworker stdout | 2022-11-28 07:20:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:20:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:33 UTC)" (scheduled at 2022-11-28 07:20:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:20:33,374 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:20:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:07 UTC)" (scheduled at 2022-11-28 07:20:37.716126+00:00) securityworker stdout | 2022-11-28 07:20:37,755 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:20:37,828 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:20:37,829 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:20:39,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:20:39,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:20:39,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:39,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:20:39,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:39,524 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 07:20:39,571 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) gunicorn-web stdout | 2022-11-28 07:20:39,604 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:20:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:25:41 UTC)" (scheduled at 2022-11-28 07:20:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:20:41,226 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:25:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:20:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:52 UTC)" (scheduled at 2022-11-28 07:20:42.901291+00:00) notificationworker stdout | 2022-11-28 07:20:42,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:20:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:20:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:15 UTC)" (scheduled at 2022-11-28 07:20:45.911636+00:00) securityworker stdout | 2022-11-28 07:20:46,009 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:20:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:17 UTC)" (scheduled at 2022-11-28 07:20:47.016425+00:00) gcworker stdout | 2022-11-28 07:20:47,087 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:20:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:25:48 UTC)" (scheduled at 2022-11-28 07:20:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:20:48,089 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:25:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:20:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:50 UTC)" (scheduled at 2022-11-28 07:20:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:20:50,185 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:20:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:51 UTC)" (scheduled at 2022-11-28 07:20:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:20:51,776 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:20:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:02 UTC)" (scheduled at 2022-11-28 07:20:52.901291+00:00) notificationworker stdout | 2022-11-28 07:20:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:20:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:23 UTC)" (scheduled at 2022-11-28 07:20:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:20:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:20:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:20:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 07:20:54,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:20:54,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:20:54,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:20:54,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 07:20:54,560 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 07:20:54,587 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:20:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:56 UTC)" (scheduled at 2022-11-28 07:20:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:20:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:20:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:57 UTC)" (scheduled at 2022-11-28 07:20:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:20:57,623 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:21:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:21:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:12 UTC)" (scheduled at 2022-11-28 07:21:02.901291+00:00) notificationworker stdout | 2022-11-28 07:21:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:21:03,409 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:03 UTC)" (scheduled at 2022-11-28 07:21:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:21:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:21:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:06 UTC)" (scheduled at 2022-11-28 07:21:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:21:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:21:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:37 UTC)" (scheduled at 2022-11-28 07:21:07.716126+00:00) securityworker stdout | 2022-11-28 07:21:07,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:21:07,844 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:21:07,845 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 07:21:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:21:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:09,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:21:09,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:21:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:21:09,537 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 07:21:09,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:21:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:22 UTC)" (scheduled at 2022-11-28 07:21:12.901291+00:00) notificationworker stdout | 2022-11-28 07:21:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:21:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:15 UTC)" (scheduled at 2022-11-28 07:21:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:21:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:21:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:45 UTC)" (scheduled at 2022-11-28 07:21:15.911636+00:00) securityworker stdout | 2022-11-28 07:21:16,104 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:21:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:47 UTC)" (scheduled at 2022-11-28 07:21:17.016425+00:00) gcworker stdout | 2022-11-28 07:21:17,122 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:21:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:32 UTC)" (scheduled at 2022-11-28 07:21:22.901291+00:00) notificationworker stdout | 2022-11-28 07:21:22,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:21:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:53 UTC)" (scheduled at 2022-11-28 07:21:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:21:23,221 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:21:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:21:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:21:24,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:21:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:21:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.290 118 0.290) gunicorn-web stdout | 2022-11-28 07:21:24,763 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.333 118 0.333) gunicorn-web stdout | 2022-11-28 07:21:24,807 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:21:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:42 UTC)" (scheduled at 2022-11-28 07:21:32.901291+00:00) notificationworker stdout | 2022-11-28 07:21:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:21:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:33 UTC)" (scheduled at 2022-11-28 07:21:33.026570+00:00) notificationworker stdout | 2022-11-28 07:21:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:21:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:33 UTC)" (scheduled at 2022-11-28 07:21:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:21:33,365 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:21:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:07 UTC)" (scheduled at 2022-11-28 07:21:37.716126+00:00) securityworker stdout | 2022-11-28 07:21:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:21:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:21:37,809 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:21:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:21:39,490 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:21:39,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:21:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:39,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 07:21:39,541 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:21:39,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" blobuploadcleanupworker stdout | 2022-11-28 07:21:40,533 [58] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 08:21:40 UTC)" (scheduled at 2022-11-28 07:21:40.531944+00:00) blobuploadcleanupworker stdout | 2022-11-28 07:21:40,536 [58] [INFO] [redis_lock.acquire] Got lock for 'lock:BLOB_CLEANUP'. blobuploadcleanupworker stdout | 2022-11-28 07:21:40,641 [58] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 08:21:40 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:21:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:52 UTC)" (scheduled at 2022-11-28 07:21:42.901291+00:00) notificationworker stdout | 2022-11-28 07:21:42,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:21:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:21:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:15 UTC)" (scheduled at 2022-11-28 07:21:45.911636+00:00) securityworker stdout | 2022-11-28 07:21:45,982 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:21:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:17 UTC)" (scheduled at 2022-11-28 07:21:47.016425+00:00) gcworker stdout | 2022-11-28 07:21:47,078 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:21:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:50 UTC)" (scheduled at 2022-11-28 07:21:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:21:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:21:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:51 UTC)" (scheduled at 2022-11-28 07:21:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:21:51,782 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:21:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:02 UTC)" (scheduled at 2022-11-28 07:21:52.901291+00:00) notificationworker stdout | 2022-11-28 07:21:52,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:21:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:23 UTC)" (scheduled at 2022-11-28 07:21:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:21:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:21:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:21:54,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:21:54,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:21:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:21:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 07:21:54,534 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) gunicorn-web stdout | 2022-11-28 07:21:54,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:21:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:56 UTC)" (scheduled at 2022-11-28 07:21:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:21:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:21:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:57 UTC)" (scheduled at 2022-11-28 07:21:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:21:57,570 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:22:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:22:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:12 UTC)" (scheduled at 2022-11-28 07:22:02.901291+00:00) notificationworker stdout | 2022-11-28 07:22:02,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:22:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:03 UTC)" (scheduled at 2022-11-28 07:22:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:22:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:22:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:06 UTC)" (scheduled at 2022-11-28 07:22:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:22:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:22:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:37 UTC)" (scheduled at 2022-11-28 07:22:07.716126+00:00) securityworker stdout | 2022-11-28 07:22:07,751 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:22:07,800 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:22:07,801 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:22:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:22:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.025 162 0.025) gunicorn-registry stdout | 2022-11-28 07:22:09,507 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:22:09,517 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:09,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:22:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.095) gunicorn-web stdout | 2022-11-28 07:22:09,568 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:22:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:22 UTC)" (scheduled at 2022-11-28 07:22:12.901291+00:00) notificationworker stdout | 2022-11-28 07:22:12,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:22:15,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:15 UTC)" (scheduled at 2022-11-28 07:22:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:22:15,040 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:22:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:45 UTC)" (scheduled at 2022-11-28 07:22:15.911636+00:00) securityworker stdout | 2022-11-28 07:22:15,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:22:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:47 UTC)" (scheduled at 2022-11-28 07:22:17.016425+00:00) gcworker stdout | 2022-11-28 07:22:17,086 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:22:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:32 UTC)" (scheduled at 2022-11-28 07:22:22.901291+00:00) notificationworker stdout | 2022-11-28 07:22:23,006 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:22:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:53 UTC)" (scheduled at 2022-11-28 07:22:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:22:23,187 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:22:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:22:24,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:22:24,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:22:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:22:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:22:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:22:24,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:22:24,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) notificationworker stdout | 2022-11-28 07:22:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:42 UTC)" (scheduled at 2022-11-28 07:22:32.901291+00:00) notificationworker stdout | 2022-11-28 07:22:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:22:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:33 UTC)" (scheduled at 2022-11-28 07:22:33.026570+00:00) notificationworker stdout | 2022-11-28 07:22:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:22:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:33 UTC)" (scheduled at 2022-11-28 07:22:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:22:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:22:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:07 UTC)" (scheduled at 2022-11-28 07:22:37.716126+00:00) securityworker stdout | 2022-11-28 07:22:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:22:37,792 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:22:37,793 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:22:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:22:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:22:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:39,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:22:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 07:22:39,538 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 07:22:39,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:22:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:52 UTC)" (scheduled at 2022-11-28 07:22:42.901291+00:00) notificationworker stdout | 2022-11-28 07:22:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:22:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:22:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:15 UTC)" (scheduled at 2022-11-28 07:22:45.911636+00:00) securityworker stdout | 2022-11-28 07:22:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:22:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:17 UTC)" (scheduled at 2022-11-28 07:22:47.016425+00:00) gcworker stdout | 2022-11-28 07:22:47,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:22:50,132 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:50 UTC)" (scheduled at 2022-11-28 07:22:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:22:50,187 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:22:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:51 UTC)" (scheduled at 2022-11-28 07:22:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:22:51,799 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:22:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:02 UTC)" (scheduled at 2022-11-28 07:22:52.901291+00:00) notificationworker stdout | 2022-11-28 07:22:52,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:22:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:23 UTC)" (scheduled at 2022-11-28 07:22:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:22:53,223 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:22:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:22:54,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:22:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:22:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:22:54,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 07:22:54,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:22:54,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) securityscanningnotificationworker stdout | 2022-11-28 07:22:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:56 UTC)" (scheduled at 2022-11-28 07:22:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:22:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:22:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:57 UTC)" (scheduled at 2022-11-28 07:22:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:22:57,568 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:23:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:23:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:12 UTC)" (scheduled at 2022-11-28 07:23:02.901291+00:00) notificationworker stdout | 2022-11-28 07:23:02,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:23:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:03 UTC)" (scheduled at 2022-11-28 07:23:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:23:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:23:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:06 UTC)" (scheduled at 2022-11-28 07:23:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:23:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:23:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:37 UTC)" (scheduled at 2022-11-28 07:23:07.716126+00:00) securityworker stdout | 2022-11-28 07:23:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:23:07,819 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:23:07,820 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:23:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:23:09,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:23:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:23:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:23:09,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 07:23:09,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 07:23:09,576 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:23:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:22 UTC)" (scheduled at 2022-11-28 07:23:12.901291+00:00) notificationworker stdout | 2022-11-28 07:23:12,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:23:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:15 UTC)" (scheduled at 2022-11-28 07:23:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:23:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:23:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:45 UTC)" (scheduled at 2022-11-28 07:23:15.911636+00:00) securityworker stdout | 2022-11-28 07:23:16,026 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:23:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:47 UTC)" (scheduled at 2022-11-28 07:23:17.016425+00:00) gcworker stdout | 2022-11-28 07:23:17,112 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:23:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:32 UTC)" (scheduled at 2022-11-28 07:23:22.901291+00:00) notificationworker stdout | 2022-11-28 07:23:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:23:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:53 UTC)" (scheduled at 2022-11-28 07:23:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:23:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:23:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:23:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:23:24,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:23:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:24,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:23:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 07:23:24,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 07:23:24,566 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:23:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:42 UTC)" (scheduled at 2022-11-28 07:23:32.901291+00:00) notificationworker stdout | 2022-11-28 07:23:32,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:23:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:33 UTC)" (scheduled at 2022-11-28 07:23:33.026570+00:00) notificationworker stdout | 2022-11-28 07:23:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:23:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:33 UTC)" (scheduled at 2022-11-28 07:23:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:23:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:23:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:07 UTC)" (scheduled at 2022-11-28 07:23:37.716126+00:00) securityworker stdout | 2022-11-28 07:23:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:23:37,815 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:23:37,818 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:23:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:28:38 UTC)" (scheduled at 2022-11-28 07:23:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:23:38,528 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:28:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:23:39,483 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:23:39,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:23:39,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:39,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:23:39,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:23:39,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.073) gunicorn-web stdout | 2022-11-28 07:23:39,545 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:23:39,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) notificationworker stdout | 2022-11-28 07:23:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:52 UTC)" (scheduled at 2022-11-28 07:23:42.901291+00:00) notificationworker stdout | 2022-11-28 07:23:42,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:23:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:23:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:15 UTC)" (scheduled at 2022-11-28 07:23:45.911636+00:00) securityworker stdout | 2022-11-28 07:23:45,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:23:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:17 UTC)" (scheduled at 2022-11-28 07:23:47.016425+00:00) gcworker stdout | 2022-11-28 07:23:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:23:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:28:49 UTC)" (scheduled at 2022-11-28 07:23:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:23:49,437 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:28:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:23:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:50 UTC)" (scheduled at 2022-11-28 07:23:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:23:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:23:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:51 UTC)" (scheduled at 2022-11-28 07:23:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:23:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:23:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:02 UTC)" (scheduled at 2022-11-28 07:23:52.901291+00:00) notificationworker stdout | 2022-11-28 07:23:52,985 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:23:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:23 UTC)" (scheduled at 2022-11-28 07:23:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:23:53,246 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:23:54,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:23:54,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:54,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:23:54,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:23:54,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:23:54,580 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.103) gunicorn-web stdout | 2022-11-28 07:23:54,626 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.159) securityscanningnotificationworker stdout | 2022-11-28 07:23:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:56 UTC)" (scheduled at 2022-11-28 07:23:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:23:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:23:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:57 UTC)" (scheduled at 2022-11-28 07:23:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:23:57,660 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:24:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:24:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:12 UTC)" (scheduled at 2022-11-28 07:24:02.901291+00:00) notificationworker stdout | 2022-11-28 07:24:03,094 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:24:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:03 UTC)" (scheduled at 2022-11-28 07:24:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:24:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:24:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:06 UTC)" (scheduled at 2022-11-28 07:24:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:24:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:24:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:37 UTC)" (scheduled at 2022-11-28 07:24:07.716126+00:00) securityworker stdout | 2022-11-28 07:24:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:24:07,788 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:24:07,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 07:24:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-registry stdout | 2022-11-28 07:24:09,497 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:24:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-web stdout | 2022-11-28 07:24:09,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:24:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:24:09,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 07:24:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:24:09,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 07:24:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:22 UTC)" (scheduled at 2022-11-28 07:24:12.901291+00:00) notificationworker stdout | 2022-11-28 07:24:12,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:24:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:15 UTC)" (scheduled at 2022-11-28 07:24:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:24:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:24:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:45 UTC)" (scheduled at 2022-11-28 07:24:15.911636+00:00) securityworker stdout | 2022-11-28 07:24:15,981 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:24:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:47 UTC)" (scheduled at 2022-11-28 07:24:17.016425+00:00) gcworker stdout | 2022-11-28 07:24:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:24:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:32 UTC)" (scheduled at 2022-11-28 07:24:22.901291+00:00) notificationworker stdout | 2022-11-28 07:24:22,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:24:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:53 UTC)" (scheduled at 2022-11-28 07:24:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:24:23,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:24:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:24:24,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:24:24,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:24:24,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:24:24,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:24:24,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:24:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:24:24,615 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.179 118 0.180) gunicorn-web stdout | 2022-11-28 07:24:24,653 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:24:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:42 UTC)" (scheduled at 2022-11-28 07:24:32.901291+00:00) notificationworker stdout | 2022-11-28 07:24:32,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:24:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:33 UTC)" (scheduled at 2022-11-28 07:24:33.026570+00:00) notificationworker stdout | 2022-11-28 07:24:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:24:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:33 UTC)" (scheduled at 2022-11-28 07:24:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:24:33,369 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:24:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:07 UTC)" (scheduled at 2022-11-28 07:24:37.716126+00:00) securityworker stdout | 2022-11-28 07:24:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:24:37,806 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:24:37,807 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:24:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:29:38 UTC)" (scheduled at 2022-11-28 07:24:38.024004+00:00) notificationworker stdout | 2022-11-28 07:24:38,084 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:29:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:24:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:24:39,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:24:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:24:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:24:39,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:24:39,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:24:39,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:24:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) notificationworker stdout | 2022-11-28 07:24:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:52 UTC)" (scheduled at 2022-11-28 07:24:42.901291+00:00) notificationworker stdout | 2022-11-28 07:24:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:24:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:24:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:15 UTC)" (scheduled at 2022-11-28 07:24:45.911636+00:00) securityworker stdout | 2022-11-28 07:24:45,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:24:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:17 UTC)" (scheduled at 2022-11-28 07:24:47.016425+00:00) gcworker stdout | 2022-11-28 07:24:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:24:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:50 UTC)" (scheduled at 2022-11-28 07:24:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:24:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:24:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:51 UTC)" (scheduled at 2022-11-28 07:24:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:24:51,800 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:24:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:02 UTC)" (scheduled at 2022-11-28 07:24:52.901291+00:00) notificationworker stdout | 2022-11-28 07:24:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:24:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:23 UTC)" (scheduled at 2022-11-28 07:24:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:24:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:24:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:24:54,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:24:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:24:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:24:54,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 07:24:54,517 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 07:24:54,555 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:24:54,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) securityscanningnotificationworker stdout | 2022-11-28 07:24:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:56 UTC)" (scheduled at 2022-11-28 07:24:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:24:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:24:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:57 UTC)" (scheduled at 2022-11-28 07:24:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:24:57,708 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:25:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:25:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:12 UTC)" (scheduled at 2022-11-28 07:25:02.901291+00:00) notificationworker stdout | 2022-11-28 07:25:02,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:25:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:03 UTC)" (scheduled at 2022-11-28 07:25:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:25:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:25:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:06 UTC)" (scheduled at 2022-11-28 07:25:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:25:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:25:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:37 UTC)" (scheduled at 2022-11-28 07:25:07.716126+00:00) securityworker stdout | 2022-11-28 07:25:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:25:07,801 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:25:07,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:25:09,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:25:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:25:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:25:09,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:25:09,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:25:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 07:25:09,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:25:09,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:25:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:22 UTC)" (scheduled at 2022-11-28 07:25:12.901291+00:00) notificationworker stdout | 2022-11-28 07:25:12,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:25:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:15 UTC)" (scheduled at 2022-11-28 07:25:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:25:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:25:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:45 UTC)" (scheduled at 2022-11-28 07:25:15.911636+00:00) securityworker stdout | 2022-11-28 07:25:15,994 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:25:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:47 UTC)" (scheduled at 2022-11-28 07:25:17.016425+00:00) gcworker stdout | 2022-11-28 07:25:17,109 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:25:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:32 UTC)" (scheduled at 2022-11-28 07:25:22.901291+00:00) notificationworker stdout | 2022-11-28 07:25:23,001 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:25:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:53 UTC)" (scheduled at 2022-11-28 07:25:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:25:23,185 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:25:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:25:24,501 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) gunicorn-registry stdout | 2022-11-28 07:25:24,507 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-web stdout | 2022-11-28 07:25:24,517 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:25:24,520 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:25:24,521 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:25:24,523 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 07:25:24,594 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:25:24,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) notificationworker stdout | 2022-11-28 07:25:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:42 UTC)" (scheduled at 2022-11-28 07:25:32.901291+00:00) notificationworker stdout | 2022-11-28 07:25:32,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:25:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:33 UTC)" (scheduled at 2022-11-28 07:25:33.026570+00:00) notificationworker stdout | 2022-11-28 07:25:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:25:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:33 UTC)" (scheduled at 2022-11-28 07:25:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:25:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:25:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:07 UTC)" (scheduled at 2022-11-28 07:25:37.716126+00:00) securityworker stdout | 2022-11-28 07:25:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:25:37,778 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:25:37,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:25:39,502 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:25:39,506 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:25:39,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:25:39,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:25:39,524 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:25:39,529 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:25:39,557 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 07:25:39,575 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) securityscanningnotificationworker stdout | 2022-11-28 07:25:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:30:41 UTC)" (scheduled at 2022-11-28 07:25:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:25:41,206 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:30:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:25:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:52 UTC)" (scheduled at 2022-11-28 07:25:42.901291+00:00) notificationworker stdout | 2022-11-28 07:25:42,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:25:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:25:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:15 UTC)" (scheduled at 2022-11-28 07:25:45.911636+00:00) securityworker stdout | 2022-11-28 07:25:45,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:25:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:17 UTC)" (scheduled at 2022-11-28 07:25:47.016425+00:00) gcworker stdout | 2022-11-28 07:25:47,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:25:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:30:48 UTC)" (scheduled at 2022-11-28 07:25:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:25:48,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:30:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:25:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:50 UTC)" (scheduled at 2022-11-28 07:25:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:25:50,166 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:25:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:51 UTC)" (scheduled at 2022-11-28 07:25:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:25:51,784 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:25:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:02 UTC)" (scheduled at 2022-11-28 07:25:52.901291+00:00) notificationworker stdout | 2022-11-28 07:25:52,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:25:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:23 UTC)" (scheduled at 2022-11-28 07:25:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:25:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:25:54,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:25:54,491 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:25:54,493 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:25:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:25:54,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:25:54,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:25:54,561 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:25:54,586 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) securityscanningnotificationworker stdout | 2022-11-28 07:25:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:56 UTC)" (scheduled at 2022-11-28 07:25:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:25:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:25:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:57 UTC)" (scheduled at 2022-11-28 07:25:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:25:57,556 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:26:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:26:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:12 UTC)" (scheduled at 2022-11-28 07:26:02.901291+00:00) notificationworker stdout | 2022-11-28 07:26:02,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:26:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:03 UTC)" (scheduled at 2022-11-28 07:26:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:26:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:26:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:06 UTC)" (scheduled at 2022-11-28 07:26:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:26:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:26:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:37 UTC)" (scheduled at 2022-11-28 07:26:07.716126+00:00) securityworker stdout | 2022-11-28 07:26:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:26:07,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:26:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:26:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:26:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:26:09,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:09,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:26:09,517 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) gunicorn-web stdout | 2022-11-28 07:26:09,581 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:26:09,580 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:26:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:22 UTC)" (scheduled at 2022-11-28 07:26:12.901291+00:00) notificationworker stdout | 2022-11-28 07:26:12,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:26:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:15 UTC)" (scheduled at 2022-11-28 07:26:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:26:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:26:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:45 UTC)" (scheduled at 2022-11-28 07:26:15.911636+00:00) securityworker stdout | 2022-11-28 07:26:15,987 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:26:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:47 UTC)" (scheduled at 2022-11-28 07:26:17.016425+00:00) gcworker stdout | 2022-11-28 07:26:17,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:26:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:32 UTC)" (scheduled at 2022-11-28 07:26:22.901291+00:00) notificationworker stdout | 2022-11-28 07:26:22,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:26:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:53 UTC)" (scheduled at 2022-11-28 07:26:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:26:23,204 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:26:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:26:24,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:26:24,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:26:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:24,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:26:24,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.188 118 0.188) gunicorn-web stdout | 2022-11-28 07:26:24,661 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:26:24,671 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.199 118 0.199) notificationworker stdout | 2022-11-28 07:26:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:42 UTC)" (scheduled at 2022-11-28 07:26:32.901291+00:00) notificationworker stdout | 2022-11-28 07:26:32,984 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:26:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:33 UTC)" (scheduled at 2022-11-28 07:26:33.026570+00:00) notificationworker stdout | 2022-11-28 07:26:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:26:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:33 UTC)" (scheduled at 2022-11-28 07:26:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:26:33,387 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:26:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:07 UTC)" (scheduled at 2022-11-28 07:26:37.716126+00:00) securityworker stdout | 2022-11-28 07:26:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:26:37,850 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:26:37,851 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:26:39,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:26:39,494 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:26:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:26:39,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:39,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 07:26:39,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 07:26:39,591 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:26:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:52 UTC)" (scheduled at 2022-11-28 07:26:42.901291+00:00) notificationworker stdout | 2022-11-28 07:26:42,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:26:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:26:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:15 UTC)" (scheduled at 2022-11-28 07:26:45.911636+00:00) securityworker stdout | 2022-11-28 07:26:46,074 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:26:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:17 UTC)" (scheduled at 2022-11-28 07:26:47.016425+00:00) gcworker stdout | 2022-11-28 07:26:47,239 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:26:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:50 UTC)" (scheduled at 2022-11-28 07:26:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:26:50,280 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:26:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:51 UTC)" (scheduled at 2022-11-28 07:26:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:26:51,808 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:26:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:02 UTC)" (scheduled at 2022-11-28 07:26:52.901291+00:00) notificationworker stdout | 2022-11-28 07:26:52,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:26:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:23 UTC)" (scheduled at 2022-11-28 07:26:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:26:53,199 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:26:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:26:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:26:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:54,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:26:54,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:26:54,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:26:54,559 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:26:54,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) securityscanningnotificationworker stdout | 2022-11-28 07:26:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:56 UTC)" (scheduled at 2022-11-28 07:26:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:26:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:26:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:57 UTC)" (scheduled at 2022-11-28 07:26:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:26:57,731 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:27:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:27:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:12 UTC)" (scheduled at 2022-11-28 07:27:02.901291+00:00) notificationworker stdout | 2022-11-28 07:27:02,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:27:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:03 UTC)" (scheduled at 2022-11-28 07:27:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:27:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:27:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:06 UTC)" (scheduled at 2022-11-28 07:27:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:27:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:27:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:37 UTC)" (scheduled at 2022-11-28 07:27:07.716126+00:00) securityworker stdout | 2022-11-28 07:27:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:27:07,794 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:27:07,795 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:27:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:27:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:27:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:27:09,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:27:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:27:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 07:27:09,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 07:27:09,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:27:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:22 UTC)" (scheduled at 2022-11-28 07:27:12.901291+00:00) notificationworker stdout | 2022-11-28 07:27:12,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:27:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:15 UTC)" (scheduled at 2022-11-28 07:27:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:27:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:27:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:45 UTC)" (scheduled at 2022-11-28 07:27:15.911636+00:00) securityworker stdout | 2022-11-28 07:27:15,993 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:27:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:47 UTC)" (scheduled at 2022-11-28 07:27:17.016425+00:00) gcworker stdout | 2022-11-28 07:27:17,086 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:27:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:32 UTC)" (scheduled at 2022-11-28 07:27:22.901291+00:00) notificationworker stdout | 2022-11-28 07:27:22,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:27:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:53 UTC)" (scheduled at 2022-11-28 07:27:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:27:23,248 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:27:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:27:24,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:27:24,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:27:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:27:24,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:27:24,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:27:24,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) gunicorn-web stdout | 2022-11-28 07:27:24,608 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:27:24,612 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) notificationworker stdout | 2022-11-28 07:27:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:42 UTC)" (scheduled at 2022-11-28 07:27:32.901291+00:00) notificationworker stdout | 2022-11-28 07:27:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:33 UTC)" (scheduled at 2022-11-28 07:27:33.026570+00:00) notificationworker stdout | 2022-11-28 07:27:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:27:33,056 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:27:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:33 UTC)" (scheduled at 2022-11-28 07:27:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:27:33,450 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:27:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:07 UTC)" (scheduled at 2022-11-28 07:27:37.716126+00:00) securityworker stdout | 2022-11-28 07:27:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:27:37,776 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:27:37,776 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:27:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:27:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:27:39,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:27:39,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:27:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:27:39,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:27:39,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:27:39,602 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) notificationworker stdout | 2022-11-28 07:27:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:52 UTC)" (scheduled at 2022-11-28 07:27:42.901291+00:00) notificationworker stdout | 2022-11-28 07:27:42,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:27:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:27:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:15 UTC)" (scheduled at 2022-11-28 07:27:45.911636+00:00) securityworker stdout | 2022-11-28 07:27:46,043 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:27:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:17 UTC)" (scheduled at 2022-11-28 07:27:47.016425+00:00) gcworker stdout | 2022-11-28 07:27:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:27:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:50 UTC)" (scheduled at 2022-11-28 07:27:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:27:50,186 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:50 UTC)" executed successfully expiredappspecifictokenworker stdout | 2022-11-28 07:27:50,337 [63] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 08:27:50 UTC)" (scheduled at 2022-11-28 07:27:50.334970+00:00) expiredappspecifictokenworker stdout | 2022-11-28 07:27:50,381 [63] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 08:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:27:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:51 UTC)" (scheduled at 2022-11-28 07:27:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:27:51,789 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:27:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:02 UTC)" (scheduled at 2022-11-28 07:27:52.901291+00:00) notificationworker stdout | 2022-11-28 07:27:52,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:27:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:23 UTC)" (scheduled at 2022-11-28 07:27:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:27:53,189 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:27:54,498 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:27:54,502 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:27:54,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:27:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:27:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:27:54,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.115) gunicorn-web stdout | 2022-11-28 07:27:54,590 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:27:54,622 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.149 118 0.150) securityscanningnotificationworker stdout | 2022-11-28 07:27:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:56 UTC)" (scheduled at 2022-11-28 07:27:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:27:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:27:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:57 UTC)" (scheduled at 2022-11-28 07:27:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:27:57,547 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:28:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:28:02,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:12 UTC)" (scheduled at 2022-11-28 07:28:02.901291+00:00) notificationworker stdout | 2022-11-28 07:28:03,084 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:28:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:03 UTC)" (scheduled at 2022-11-28 07:28:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:28:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:28:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:06 UTC)" (scheduled at 2022-11-28 07:28:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:28:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:28:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:37 UTC)" (scheduled at 2022-11-28 07:28:07.716126+00:00) securityworker stdout | 2022-11-28 07:28:07,741 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:28:07,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:28:07,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:28:09,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:28:09,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:28:09,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:28:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:09,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 07:28:09,579 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.157 118 0.157) gunicorn-web stdout | 2022-11-28 07:28:09,629 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:28:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:22 UTC)" (scheduled at 2022-11-28 07:28:12.901291+00:00) notificationworker stdout | 2022-11-28 07:28:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:28:15,042 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:15 UTC)" (scheduled at 2022-11-28 07:28:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:28:15,043 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:28:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:45 UTC)" (scheduled at 2022-11-28 07:28:15.911636+00:00) securityworker stdout | 2022-11-28 07:28:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:28:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:47 UTC)" (scheduled at 2022-11-28 07:28:17.016425+00:00) gcworker stdout | 2022-11-28 07:28:17,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:28:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:32 UTC)" (scheduled at 2022-11-28 07:28:22.901291+00:00) notificationworker stdout | 2022-11-28 07:28:22,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:28:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:53 UTC)" (scheduled at 2022-11-28 07:28:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:28:23,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:28:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:28:24,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:28:24,485 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 07:28:24,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:28:24,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:28:24,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 07:28:24,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:28:24,578 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) notificationworker stdout | 2022-11-28 07:28:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:42 UTC)" (scheduled at 2022-11-28 07:28:32.901291+00:00) notificationworker stdout | 2022-11-28 07:28:32,989 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:28:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:33 UTC)" (scheduled at 2022-11-28 07:28:33.026570+00:00) notificationworker stdout | 2022-11-28 07:28:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:28:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:33 UTC)" (scheduled at 2022-11-28 07:28:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:28:33,379 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:28:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:07 UTC)" (scheduled at 2022-11-28 07:28:37.716126+00:00) securityworker stdout | 2022-11-28 07:28:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:28:37,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:28:37,796 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:28:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:33:38 UTC)" (scheduled at 2022-11-28 07:28:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:28:38,498 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:33:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:28:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:28:39,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:28:39,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:39,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:28:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:39,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 07:28:39,540 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:28:39,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) notificationworker stdout | 2022-11-28 07:28:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:52 UTC)" (scheduled at 2022-11-28 07:28:42.901291+00:00) notificationworker stdout | 2022-11-28 07:28:42,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:28:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:28:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:15 UTC)" (scheduled at 2022-11-28 07:28:45.911636+00:00) securityworker stdout | 2022-11-28 07:28:45,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:28:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:17 UTC)" (scheduled at 2022-11-28 07:28:47.016425+00:00) gcworker stdout | 2022-11-28 07:28:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:28:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:33:49 UTC)" (scheduled at 2022-11-28 07:28:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:28:49,486 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:33:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:28:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:50 UTC)" (scheduled at 2022-11-28 07:28:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:28:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:28:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:51 UTC)" (scheduled at 2022-11-28 07:28:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:28:51,776 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:28:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:02 UTC)" (scheduled at 2022-11-28 07:28:52.901291+00:00) notificationworker stdout | 2022-11-28 07:28:52,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:28:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:23 UTC)" (scheduled at 2022-11-28 07:28:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:28:53,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:28:54,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:28:54,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:28:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:28:54,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:28:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:28:54,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:28:54,578 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) securityscanningnotificationworker stdout | 2022-11-28 07:28:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:56 UTC)" (scheduled at 2022-11-28 07:28:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:28:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:28:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:57 UTC)" (scheduled at 2022-11-28 07:28:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:28:57,574 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:29:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:29:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:12 UTC)" (scheduled at 2022-11-28 07:29:02.901291+00:00) notificationworker stdout | 2022-11-28 07:29:02,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:29:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:03 UTC)" (scheduled at 2022-11-28 07:29:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:29:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:29:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:06 UTC)" (scheduled at 2022-11-28 07:29:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:29:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:29:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:37 UTC)" (scheduled at 2022-11-28 07:29:07.716126+00:00) securityworker stdout | 2022-11-28 07:29:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:29:07,879 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:29:07,880 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:29:09,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:29:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:29:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:09,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:29:09,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:29:09,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 07:29:09,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:29:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) notificationworker stdout | 2022-11-28 07:29:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:22 UTC)" (scheduled at 2022-11-28 07:29:12.901291+00:00) notificationworker stdout | 2022-11-28 07:29:12,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:29:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:15 UTC)" (scheduled at 2022-11-28 07:29:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:29:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:29:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:45 UTC)" (scheduled at 2022-11-28 07:29:15.911636+00:00) securityworker stdout | 2022-11-28 07:29:15,986 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:29:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:47 UTC)" (scheduled at 2022-11-28 07:29:17.016425+00:00) gcworker stdout | 2022-11-28 07:29:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:29:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:32 UTC)" (scheduled at 2022-11-28 07:29:22.901291+00:00) notificationworker stdout | 2022-11-28 07:29:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:29:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:53 UTC)" (scheduled at 2022-11-28 07:29:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:29:23,187 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:29:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:29:24,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:29:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.019 162 0.019) gunicorn-registry stdout | 2022-11-28 07:29:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:29:24,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:24,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 07:29:24,571 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 07:29:24,584 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:29:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:42 UTC)" (scheduled at 2022-11-28 07:29:32.901291+00:00) notificationworker stdout | 2022-11-28 07:29:32,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:29:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:33 UTC)" (scheduled at 2022-11-28 07:29:33.026570+00:00) notificationworker stdout | 2022-11-28 07:29:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:29:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:33 UTC)" (scheduled at 2022-11-28 07:29:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:29:33,379 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:29:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:07 UTC)" (scheduled at 2022-11-28 07:29:37.716126+00:00) securityworker stdout | 2022-11-28 07:29:37,749 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:29:37,807 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:29:37,808 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:29:38,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:34:38 UTC)" (scheduled at 2022-11-28 07:29:38.024004+00:00) notificationworker stdout | 2022-11-28 07:29:38,131 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:34:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:29:39,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:29:39,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:29:39,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:39,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:29:39,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:29:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 07:29:39,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 07:29:39,588 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:29:42,910 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:52 UTC)" (scheduled at 2022-11-28 07:29:42.901291+00:00) notificationworker stdout | 2022-11-28 07:29:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:29:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:29:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:15 UTC)" (scheduled at 2022-11-28 07:29:45.911636+00:00) securityworker stdout | 2022-11-28 07:29:45,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:29:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:17 UTC)" (scheduled at 2022-11-28 07:29:47.016425+00:00) gcworker stdout | 2022-11-28 07:29:47,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:29:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:50 UTC)" (scheduled at 2022-11-28 07:29:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:29:50,182 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:29:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:51 UTC)" (scheduled at 2022-11-28 07:29:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:29:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:29:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:02 UTC)" (scheduled at 2022-11-28 07:29:52.901291+00:00) notificationworker stdout | 2022-11-28 07:29:52,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:29:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:23 UTC)" (scheduled at 2022-11-28 07:29:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:29:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:29:54,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-registry stdout | 2022-11-28 07:29:54,502 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.018 162 0.018) gunicorn-web stdout | 2022-11-28 07:29:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:29:54,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:29:54,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 07:29:54,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 07:29:54,573 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:29:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:56 UTC)" (scheduled at 2022-11-28 07:29:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:29:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:29:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:57 UTC)" (scheduled at 2022-11-28 07:29:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:29:57,751 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:30:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:30:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:12 UTC)" (scheduled at 2022-11-28 07:30:02.901291+00:00) notificationworker stdout | 2022-11-28 07:30:02,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:30:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:03 UTC)" (scheduled at 2022-11-28 07:30:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:30:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:30:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:06 UTC)" (scheduled at 2022-11-28 07:30:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:30:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:30:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:37 UTC)" (scheduled at 2022-11-28 07:30:07.716126+00:00) securityworker stdout | 2022-11-28 07:30:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:30:07,862 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:30:07,862 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:30:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:30:09,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:30:09,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:09,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:30:09,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) gunicorn-web stdout | 2022-11-28 07:30:09,579 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) gunicorn-web stdout | 2022-11-28 07:30:09,603 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:30:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:22 UTC)" (scheduled at 2022-11-28 07:30:12.901291+00:00) notificationworker stdout | 2022-11-28 07:30:12,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:30:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:15 UTC)" (scheduled at 2022-11-28 07:30:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:30:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:30:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:45 UTC)" (scheduled at 2022-11-28 07:30:15.911636+00:00) securityworker stdout | 2022-11-28 07:30:16,058 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:30:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:47 UTC)" (scheduled at 2022-11-28 07:30:17.016425+00:00) gcworker stdout | 2022-11-28 07:30:17,288 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:30:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:32 UTC)" (scheduled at 2022-11-28 07:30:22.901291+00:00) notificationworker stdout | 2022-11-28 07:30:22,975 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:30:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:53 UTC)" (scheduled at 2022-11-28 07:30:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:30:23,240 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:30:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:30:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:30:24,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:30:24,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:24,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:30:24,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 07:30:24,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.257 118 0.257) gunicorn-web stdout | 2022-11-28 07:30:24,731 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:30:24,787 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.315 118 0.315) notificationworker stdout | 2022-11-28 07:30:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:42 UTC)" (scheduled at 2022-11-28 07:30:32.901291+00:00) notificationworker stdout | 2022-11-28 07:30:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:33 UTC)" (scheduled at 2022-11-28 07:30:33.026570+00:00) notificationworker stdout | 2022-11-28 07:30:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:30:33,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:30:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:33 UTC)" (scheduled at 2022-11-28 07:30:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:30:33,382 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:30:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:07 UTC)" (scheduled at 2022-11-28 07:30:37.716126+00:00) securityworker stdout | 2022-11-28 07:30:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:30:37,812 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:30:37,813 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:30:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:30:39,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:30:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:30:39,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:30:39,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:39,591 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 07:30:39,594 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:30:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:35:41 UTC)" (scheduled at 2022-11-28 07:30:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:30:41,230 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:35:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:30:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:52 UTC)" (scheduled at 2022-11-28 07:30:42.901291+00:00) notificationworker stdout | 2022-11-28 07:30:42,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:30:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:30:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:15 UTC)" (scheduled at 2022-11-28 07:30:45.911636+00:00) securityworker stdout | 2022-11-28 07:30:46,010 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:30:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:17 UTC)" (scheduled at 2022-11-28 07:30:47.016425+00:00) gcworker stdout | 2022-11-28 07:30:47,115 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:30:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:35:48 UTC)" (scheduled at 2022-11-28 07:30:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:30:48,148 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:35:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:30:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:50 UTC)" (scheduled at 2022-11-28 07:30:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:30:50,195 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:30:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:51 UTC)" (scheduled at 2022-11-28 07:30:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:30:51,816 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:30:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:02 UTC)" (scheduled at 2022-11-28 07:30:52.901291+00:00) notificationworker stdout | 2022-11-28 07:30:52,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:30:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:23 UTC)" (scheduled at 2022-11-28 07:30:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:30:53,164 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:30:54,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:30:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 07:30:54,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.058 162 0.058) gunicorn-registry stdout | 2022-11-28 07:30:54,543 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:30:54,555 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:30:54,557 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) gunicorn-web stdout | 2022-11-28 07:30:54,632 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:30:54,702 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.230 118 0.230) securityscanningnotificationworker stdout | 2022-11-28 07:30:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:56 UTC)" (scheduled at 2022-11-28 07:30:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:30:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:30:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:57 UTC)" (scheduled at 2022-11-28 07:30:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:30:57,688 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:31:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:31:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:12 UTC)" (scheduled at 2022-11-28 07:31:02.901291+00:00) notificationworker stdout | 2022-11-28 07:31:02,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:31:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:03 UTC)" (scheduled at 2022-11-28 07:31:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:31:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:31:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:06 UTC)" (scheduled at 2022-11-28 07:31:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:31:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:31:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:37 UTC)" (scheduled at 2022-11-28 07:31:07.716126+00:00) securityworker stdout | 2022-11-28 07:31:07,761 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:31:07,884 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:31:07,885 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:31:09,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:31:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-registry stdout | 2022-11-28 07:31:09,501 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) gunicorn-web stdout | 2022-11-28 07:31:09,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:31:09,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 07:31:09,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:31:09,584 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) notificationworker stdout | 2022-11-28 07:31:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:22 UTC)" (scheduled at 2022-11-28 07:31:12.901291+00:00) notificationworker stdout | 2022-11-28 07:31:12,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:31:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:15 UTC)" (scheduled at 2022-11-28 07:31:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:31:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:31:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:45 UTC)" (scheduled at 2022-11-28 07:31:15.911636+00:00) securityworker stdout | 2022-11-28 07:31:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:31:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:47 UTC)" (scheduled at 2022-11-28 07:31:17.016425+00:00) gcworker stdout | 2022-11-28 07:31:17,097 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:31:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:32 UTC)" (scheduled at 2022-11-28 07:31:22.901291+00:00) notificationworker stdout | 2022-11-28 07:31:22,990 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:31:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:53 UTC)" (scheduled at 2022-11-28 07:31:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:31:23,171 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:31:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:31:24,487 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:31:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:31:24,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 07:31:24,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:24,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:31:24,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 07:31:24,592 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:31:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:42 UTC)" (scheduled at 2022-11-28 07:31:32.901291+00:00) notificationworker stdout | 2022-11-28 07:31:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:33 UTC)" (scheduled at 2022-11-28 07:31:33.026570+00:00) notificationworker stdout | 2022-11-28 07:31:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:31:33,156 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:31:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:33 UTC)" (scheduled at 2022-11-28 07:31:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:31:33,414 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:31:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:07 UTC)" (scheduled at 2022-11-28 07:31:37.716126+00:00) securityworker stdout | 2022-11-28 07:31:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:31:37,789 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:31:37,790 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:31:39,483 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:31:39,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:39,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:31:39,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:31:39,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:39,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:31:39,557 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.087) gunicorn-web stdout | 2022-11-28 07:31:39,559 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:31:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:52 UTC)" (scheduled at 2022-11-28 07:31:42.901291+00:00) notificationworker stdout | 2022-11-28 07:31:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:31:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:31:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:15 UTC)" (scheduled at 2022-11-28 07:31:45.911636+00:00) securityworker stdout | 2022-11-28 07:31:45,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:31:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:17 UTC)" (scheduled at 2022-11-28 07:31:47.016425+00:00) gcworker stdout | 2022-11-28 07:31:47,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:31:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:50 UTC)" (scheduled at 2022-11-28 07:31:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:31:50,177 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:31:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:51 UTC)" (scheduled at 2022-11-28 07:31:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:31:51,813 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:31:52,912 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:02 UTC)" (scheduled at 2022-11-28 07:31:52.901291+00:00) notificationworker stdout | 2022-11-28 07:31:52,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:31:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:23 UTC)" (scheduled at 2022-11-28 07:31:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:31:53,192 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:31:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:31:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:31:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:31:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:31:54,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:31:54,582 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:31:54,583 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) securityscanningnotificationworker stdout | 2022-11-28 07:31:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:56 UTC)" (scheduled at 2022-11-28 07:31:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:31:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:31:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:57 UTC)" (scheduled at 2022-11-28 07:31:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:31:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:32:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:32:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:12 UTC)" (scheduled at 2022-11-28 07:32:02.901291+00:00) notificationworker stdout | 2022-11-28 07:32:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:32:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:03 UTC)" (scheduled at 2022-11-28 07:32:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:32:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:32:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:06 UTC)" (scheduled at 2022-11-28 07:32:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:32:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:32:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:37 UTC)" (scheduled at 2022-11-28 07:32:07.716126+00:00) securityworker stdout | 2022-11-28 07:32:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:32:07,793 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:32:07,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:32:09,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:32:09,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:32:09,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:32:09,524 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:09,530 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 07:32:09,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 07:32:09,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:32:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:22 UTC)" (scheduled at 2022-11-28 07:32:12.901291+00:00) notificationworker stdout | 2022-11-28 07:32:12,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:32:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:15 UTC)" (scheduled at 2022-11-28 07:32:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:32:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:32:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:45 UTC)" (scheduled at 2022-11-28 07:32:15.911636+00:00) securityworker stdout | 2022-11-28 07:32:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:32:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:47 UTC)" (scheduled at 2022-11-28 07:32:17.016425+00:00) gcworker stdout | 2022-11-28 07:32:17,113 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:32:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:32 UTC)" (scheduled at 2022-11-28 07:32:22.901291+00:00) notificationworker stdout | 2022-11-28 07:32:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:32:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:53 UTC)" (scheduled at 2022-11-28 07:32:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:32:23,185 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:32:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:32:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:32:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:32:24,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:24,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:32:24,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:32:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:32:24,601 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 07:32:24,631 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.154 118 0.154) notificationworker stdout | 2022-11-28 07:32:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:42 UTC)" (scheduled at 2022-11-28 07:32:32.901291+00:00) notificationworker stdout | 2022-11-28 07:32:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:32:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:33 UTC)" (scheduled at 2022-11-28 07:32:33.026570+00:00) notificationworker stdout | 2022-11-28 07:32:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:32:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:33 UTC)" (scheduled at 2022-11-28 07:32:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:32:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:32:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:07 UTC)" (scheduled at 2022-11-28 07:32:37.716126+00:00) securityworker stdout | 2022-11-28 07:32:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:32:37,791 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:32:37,792 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:32:39,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 07:32:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:32:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:32:39,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:39,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) gunicorn-web stdout | 2022-11-28 07:32:39,536 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:32:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 07:32:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:52 UTC)" (scheduled at 2022-11-28 07:32:42.901291+00:00) notificationworker stdout | 2022-11-28 07:32:42,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:32:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:32:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:15 UTC)" (scheduled at 2022-11-28 07:32:45.911636+00:00) securityworker stdout | 2022-11-28 07:32:46,104 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:32:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:17 UTC)" (scheduled at 2022-11-28 07:32:47.016425+00:00) gcworker stdout | 2022-11-28 07:32:47,100 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:32:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:50 UTC)" (scheduled at 2022-11-28 07:32:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:32:50,171 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:32:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:51 UTC)" (scheduled at 2022-11-28 07:32:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:32:51,795 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:32:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:02 UTC)" (scheduled at 2022-11-28 07:32:52.901291+00:00) notificationworker stdout | 2022-11-28 07:32:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:32:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:23 UTC)" (scheduled at 2022-11-28 07:32:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:32:53,175 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:32:54,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:32:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 07:32:54,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:54,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 07:32:54,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:32:54,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 07:32:54,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 07:32:54,580 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:32:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:56 UTC)" (scheduled at 2022-11-28 07:32:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:32:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:32:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:57 UTC)" (scheduled at 2022-11-28 07:32:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:32:57,618 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:33:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:33:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:12 UTC)" (scheduled at 2022-11-28 07:33:02.901291+00:00) notificationworker stdout | 2022-11-28 07:33:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:33:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:03 UTC)" (scheduled at 2022-11-28 07:33:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:33:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:33:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:06 UTC)" (scheduled at 2022-11-28 07:33:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:33:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:33:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:37 UTC)" (scheduled at 2022-11-28 07:33:07.716126+00:00) securityworker stdout | 2022-11-28 07:33:07,757 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:33:07,896 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:33:07,897 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:33:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:33:09,485 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:33:09,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:33:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 07:33:09,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:33:09,571 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) notificationworker stdout | 2022-11-28 07:33:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:22 UTC)" (scheduled at 2022-11-28 07:33:12.901291+00:00) notificationworker stdout | 2022-11-28 07:33:12,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:33:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:15 UTC)" (scheduled at 2022-11-28 07:33:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:33:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:33:15,916 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:45 UTC)" (scheduled at 2022-11-28 07:33:15.911636+00:00) securityworker stdout | 2022-11-28 07:33:16,053 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:33:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:47 UTC)" (scheduled at 2022-11-28 07:33:17.016425+00:00) gcworker stdout | 2022-11-28 07:33:17,236 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:33:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:32 UTC)" (scheduled at 2022-11-28 07:33:22.901291+00:00) notificationworker stdout | 2022-11-28 07:33:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:33:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:53 UTC)" (scheduled at 2022-11-28 07:33:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:33:23,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:33:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:33:24,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 07:33:24,501 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:24,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 07:33:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:33:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 07:33:24,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:33:24,561 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 07:33:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:42 UTC)" (scheduled at 2022-11-28 07:33:32.901291+00:00) notificationworker stdout | 2022-11-28 07:33:32,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:33:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:33 UTC)" (scheduled at 2022-11-28 07:33:33.026570+00:00) notificationworker stdout | 2022-11-28 07:33:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:33:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:33 UTC)" (scheduled at 2022-11-28 07:33:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:33:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:33:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:07 UTC)" (scheduled at 2022-11-28 07:33:37.716126+00:00) securityworker stdout | 2022-11-28 07:33:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:33:37,785 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:33:37,786 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:33:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:38:38 UTC)" (scheduled at 2022-11-28 07:33:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:33:38,496 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:38:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:33:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:33:39,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:33:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:33:39,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:33:39,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 07:33:39,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:33:39,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.080) notificationworker stdout | 2022-11-28 07:33:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:52 UTC)" (scheduled at 2022-11-28 07:33:42.901291+00:00) notificationworker stdout | 2022-11-28 07:33:42,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:33:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:33:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:15 UTC)" (scheduled at 2022-11-28 07:33:45.911636+00:00) securityworker stdout | 2022-11-28 07:33:46,030 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:33:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:17 UTC)" (scheduled at 2022-11-28 07:33:47.016425+00:00) gcworker stdout | 2022-11-28 07:33:47,074 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:33:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:38:49 UTC)" (scheduled at 2022-11-28 07:33:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:33:49,440 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:38:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:33:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:50 UTC)" (scheduled at 2022-11-28 07:33:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:33:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:33:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:51 UTC)" (scheduled at 2022-11-28 07:33:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:33:51,822 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:33:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:02 UTC)" (scheduled at 2022-11-28 07:33:52.901291+00:00) notificationworker stdout | 2022-11-28 07:33:52,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:33:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:23 UTC)" (scheduled at 2022-11-28 07:33:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:33:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:33:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:33:54,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:33:54,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:33:54,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:33:54,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:33:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 07:33:54,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.189 118 0.189) gunicorn-web stdout | 2022-11-28 07:33:54,665 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:33:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:56 UTC)" (scheduled at 2022-11-28 07:33:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:33:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:33:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:57 UTC)" (scheduled at 2022-11-28 07:33:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:33:57,696 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:34:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:34:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:12 UTC)" (scheduled at 2022-11-28 07:34:02.901291+00:00) notificationworker stdout | 2022-11-28 07:34:03,027 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:34:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:03 UTC)" (scheduled at 2022-11-28 07:34:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:34:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:34:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:06 UTC)" (scheduled at 2022-11-28 07:34:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:34:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:34:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:37 UTC)" (scheduled at 2022-11-28 07:34:07.716126+00:00) securityworker stdout | 2022-11-28 07:34:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:34:07,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:34:07,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) gunicorn-registry stdout | 2022-11-28 07:34:09,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:34:09,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:34:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:09,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:09,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:34:09,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:34:09,531 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:34:09,532 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) notificationworker stdout | 2022-11-28 07:34:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:22 UTC)" (scheduled at 2022-11-28 07:34:12.901291+00:00) notificationworker stdout | 2022-11-28 07:34:12,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:34:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:15 UTC)" (scheduled at 2022-11-28 07:34:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:34:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:34:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:45 UTC)" (scheduled at 2022-11-28 07:34:15.911636+00:00) securityworker stdout | 2022-11-28 07:34:15,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:34:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:47 UTC)" (scheduled at 2022-11-28 07:34:17.016425+00:00) gcworker stdout | 2022-11-28 07:34:17,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:34:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:32 UTC)" (scheduled at 2022-11-28 07:34:22.901291+00:00) notificationworker stdout | 2022-11-28 07:34:22,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:34:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:53 UTC)" (scheduled at 2022-11-28 07:34:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:34:23,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:34:53 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:34:23 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.151 1439 0.151) gunicorn-registry stdout | 2022-11-28 07:34:23,579 [241] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:34:23 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:34:24,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:34:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:34:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:24,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:34:24,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:24,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 07:34:24,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:34:24,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 07:34:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:42 UTC)" (scheduled at 2022-11-28 07:34:32.901291+00:00) notificationworker stdout | 2022-11-28 07:34:32,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:34:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:33 UTC)" (scheduled at 2022-11-28 07:34:33.026570+00:00) notificationworker stdout | 2022-11-28 07:34:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:34:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:33 UTC)" (scheduled at 2022-11-28 07:34:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:34:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:34:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:07 UTC)" (scheduled at 2022-11-28 07:34:37.716126+00:00) securityworker stdout | 2022-11-28 07:34:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:34:37,767 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:34:37,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:34:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:39:38 UTC)" (scheduled at 2022-11-28 07:34:38.024004+00:00) notificationworker stdout | 2022-11-28 07:34:38,067 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:39:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 07:34:39,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:34:39,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:34:39,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:39,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:34:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:39,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:34:39,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:34:39,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 07:34:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:52 UTC)" (scheduled at 2022-11-28 07:34:42.901291+00:00) notificationworker stdout | 2022-11-28 07:34:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:34:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:34:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:15 UTC)" (scheduled at 2022-11-28 07:34:45.911636+00:00) securityworker stdout | 2022-11-28 07:34:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:34:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:17 UTC)" (scheduled at 2022-11-28 07:34:47.016425+00:00) gcworker stdout | 2022-11-28 07:34:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:34:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:50 UTC)" (scheduled at 2022-11-28 07:34:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:34:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:34:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:51 UTC)" (scheduled at 2022-11-28 07:34:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:34:51,780 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:34:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:02 UTC)" (scheduled at 2022-11-28 07:34:52.901291+00:00) notificationworker stdout | 2022-11-28 07:34:52,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:34:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:23 UTC)" (scheduled at 2022-11-28 07:34:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:34:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:34:54,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:34:54,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:34:54,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:54,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:34:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:34:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 07:34:54,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 07:34:54,580 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:34:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:56 UTC)" (scheduled at 2022-11-28 07:34:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:34:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:34:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:57 UTC)" (scheduled at 2022-11-28 07:34:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:34:57,572 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:35:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:35:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:12 UTC)" (scheduled at 2022-11-28 07:35:02.901291+00:00) notificationworker stdout | 2022-11-28 07:35:02,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:35:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:03 UTC)" (scheduled at 2022-11-28 07:35:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:35:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:35:06,426 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:06 UTC)" (scheduled at 2022-11-28 07:35:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:35:06,427 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:35:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:37 UTC)" (scheduled at 2022-11-28 07:35:07.716126+00:00) securityworker stdout | 2022-11-28 07:35:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:35:07,811 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:35:07,811 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:35:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:35:09,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:35:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:35:09,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:09,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.148 118 0.148) gunicorn-web stdout | 2022-11-28 07:35:09,620 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:35:09,620 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) notificationworker stdout | 2022-11-28 07:35:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:22 UTC)" (scheduled at 2022-11-28 07:35:12.901291+00:00) notificationworker stdout | 2022-11-28 07:35:13,094 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:35:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:15 UTC)" (scheduled at 2022-11-28 07:35:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:35:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:35:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:45 UTC)" (scheduled at 2022-11-28 07:35:15.911636+00:00) securityworker stdout | 2022-11-28 07:35:16,007 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:35:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:47 UTC)" (scheduled at 2022-11-28 07:35:17.016425+00:00) gcworker stdout | 2022-11-28 07:35:17,116 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:35:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:32 UTC)" (scheduled at 2022-11-28 07:35:22.901291+00:00) notificationworker stdout | 2022-11-28 07:35:22,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:35:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:53 UTC)" (scheduled at 2022-11-28 07:35:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:35:23,193 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:35:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:35:24,495 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 07:35:24,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:35:24,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:24,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:35:24,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:24,517 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:35:24,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:35:24,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:35:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:42 UTC)" (scheduled at 2022-11-28 07:35:32.901291+00:00) notificationworker stdout | 2022-11-28 07:35:32,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:35:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:33 UTC)" (scheduled at 2022-11-28 07:35:33.026570+00:00) notificationworker stdout | 2022-11-28 07:35:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:35:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:33 UTC)" (scheduled at 2022-11-28 07:35:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:35:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:35:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:07 UTC)" (scheduled at 2022-11-28 07:35:37.716126+00:00) securityworker stdout | 2022-11-28 07:35:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:35:37,856 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:35:37,857 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:35:39,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:35:39,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:35:39,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:35:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:39,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 07:35:39,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:35:39,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) securityscanningnotificationworker stdout | 2022-11-28 07:35:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:40:41 UTC)" (scheduled at 2022-11-28 07:35:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:35:41,204 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:40:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:35:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:52 UTC)" (scheduled at 2022-11-28 07:35:42.901291+00:00) notificationworker stdout | 2022-11-28 07:35:42,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:35:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:35:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:15 UTC)" (scheduled at 2022-11-28 07:35:45.911636+00:00) securityworker stdout | 2022-11-28 07:35:45,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:35:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:17 UTC)" (scheduled at 2022-11-28 07:35:47.016425+00:00) gcworker stdout | 2022-11-28 07:35:47,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:35:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:40:48 UTC)" (scheduled at 2022-11-28 07:35:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:35:48,085 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:40:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:35:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:50 UTC)" (scheduled at 2022-11-28 07:35:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:35:50,186 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:35:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:51 UTC)" (scheduled at 2022-11-28 07:35:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:35:51,793 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:35:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:02 UTC)" (scheduled at 2022-11-28 07:35:52.901291+00:00) notificationworker stdout | 2022-11-28 07:35:52,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:35:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:23 UTC)" (scheduled at 2022-11-28 07:35:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:35:53,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:35:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:35:54,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:35:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:35:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:35:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:35:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 07:35:54,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:35:54,538 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) securityscanningnotificationworker stdout | 2022-11-28 07:35:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:56 UTC)" (scheduled at 2022-11-28 07:35:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:35:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:35:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:57 UTC)" (scheduled at 2022-11-28 07:35:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:35:57,572 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:36:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:36:02,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:12 UTC)" (scheduled at 2022-11-28 07:36:02.901291+00:00) notificationworker stdout | 2022-11-28 07:36:02,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:36:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:03 UTC)" (scheduled at 2022-11-28 07:36:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:36:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:36:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:06 UTC)" (scheduled at 2022-11-28 07:36:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:36:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:36:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:37 UTC)" (scheduled at 2022-11-28 07:36:07.716126+00:00) securityworker stdout | 2022-11-28 07:36:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:36:07,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:36:07,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:36:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 07:36:09,497 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:36:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:36:09,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:36:09,516 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:36:09,518 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:36:09,543 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:36:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:36:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:22 UTC)" (scheduled at 2022-11-28 07:36:12.901291+00:00) notificationworker stdout | 2022-11-28 07:36:12,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:36:15,041 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:15 UTC)" (scheduled at 2022-11-28 07:36:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:36:15,042 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:36:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:45 UTC)" (scheduled at 2022-11-28 07:36:15.911636+00:00) securityworker stdout | 2022-11-28 07:36:16,003 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:36:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:47 UTC)" (scheduled at 2022-11-28 07:36:17.016425+00:00) gcworker stdout | 2022-11-28 07:36:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:36:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:32 UTC)" (scheduled at 2022-11-28 07:36:22.901291+00:00) notificationworker stdout | 2022-11-28 07:36:22,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:36:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:53 UTC)" (scheduled at 2022-11-28 07:36:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:36:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:36:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:36:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) gunicorn-registry stdout | 2022-11-28 07:36:24,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:36:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:36:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:36:24,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:36:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 07:36:24,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 07:36:24,580 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:36:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:42 UTC)" (scheduled at 2022-11-28 07:36:32.901291+00:00) notificationworker stdout | 2022-11-28 07:36:32,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:36:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:33 UTC)" (scheduled at 2022-11-28 07:36:33.026570+00:00) notificationworker stdout | 2022-11-28 07:36:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:36:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:33 UTC)" (scheduled at 2022-11-28 07:36:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:36:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:36:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:07 UTC)" (scheduled at 2022-11-28 07:36:37.716126+00:00) securityworker stdout | 2022-11-28 07:36:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:36:37,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:36:37,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:36:39,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:36:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:36:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:36:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:36:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:36:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 07:36:39,549 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:36:39,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) notificationworker stdout | 2022-11-28 07:36:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:52 UTC)" (scheduled at 2022-11-28 07:36:42.901291+00:00) notificationworker stdout | 2022-11-28 07:36:42,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:36:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:36:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:15 UTC)" (scheduled at 2022-11-28 07:36:45.911636+00:00) securityworker stdout | 2022-11-28 07:36:45,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:36:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:17 UTC)" (scheduled at 2022-11-28 07:36:47.016425+00:00) gcworker stdout | 2022-11-28 07:36:47,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:36:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:50 UTC)" (scheduled at 2022-11-28 07:36:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:36:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:36:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:51 UTC)" (scheduled at 2022-11-28 07:36:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:36:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:36:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:02 UTC)" (scheduled at 2022-11-28 07:36:52.901291+00:00) notificationworker stdout | 2022-11-28 07:36:52,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:36:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:23 UTC)" (scheduled at 2022-11-28 07:36:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:36:53,188 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:36:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:36:54,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:36:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:36:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:36:54,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:36:54,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:36:54,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 07:36:54,568 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:36:55 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (1.080 635 1.080) gunicorn-registry stdout | 2022-11-28 07:36:55,167 [243] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:36:55 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" securityscanningnotificationworker stdout | 2022-11-28 07:36:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:56 UTC)" (scheduled at 2022-11-28 07:36:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:36:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:56 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:36:56 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.263 1652 0.263) gunicorn-registry stdout | 2022-11-28 07:36:56,794 [245] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:36:56 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:36:57,066 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:36:57,144 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:07:36:57 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:36:57 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.301 1631 0.301) securityscanningnotificationworker stdout | 2022-11-28 07:36:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:57 UTC)" (scheduled at 2022-11-28 07:36:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:36:57,583 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:37:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:37:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:12 UTC)" (scheduled at 2022-11-28 07:37:02.901291+00:00) notificationworker stdout | 2022-11-28 07:37:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:37:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:03 UTC)" (scheduled at 2022-11-28 07:37:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:37:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:37:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:06 UTC)" (scheduled at 2022-11-28 07:37:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:37:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:37:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:37 UTC)" (scheduled at 2022-11-28 07:37:07.716126+00:00) securityworker stdout | 2022-11-28 07:37:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:37:07,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:37:07,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:37:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:37:09,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:37:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:37:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:37:09,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:37:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:37:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:37:09,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:37:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:22 UTC)" (scheduled at 2022-11-28 07:37:12.901291+00:00) notificationworker stdout | 2022-11-28 07:37:12,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:22 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:37:13,887 [246] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:37:13 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:37:13 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.559 635 0.559) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.221 1652 0.221) gunicorn-registry stdout | 2022-11-28 07:37:14,120 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:37:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:37:14,122 [245] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:37:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.028 1652 0.028) gunicorn-registry stdout | 2022-11-28 07:37:14,215 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:37:14,220 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:07:37:14 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:14 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.034 1631 0.034) gunicorn-registry stdout | 2022-11-28 07:37:14,428 [244] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:37:14,445 [244] [INFO] [gunicorn.access] - - [28/Nov/2022:07:37:14 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:14 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.281 1631 0.282) exportactionlogsworker stdout | 2022-11-28 07:37:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:15 UTC)" (scheduled at 2022-11-28 07:37:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:37:15,039 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:37:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:45 UTC)" (scheduled at 2022-11-28 07:37:15.911636+00:00) securityworker stdout | 2022-11-28 07:37:15,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:37:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:47 UTC)" (scheduled at 2022-11-28 07:37:17.016425+00:00) gcworker stdout | 2022-11-28 07:37:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:37:22,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:32 UTC)" (scheduled at 2022-11-28 07:37:22.901291+00:00) notificationworker stdout | 2022-11-28 07:37:22,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:37:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:53 UTC)" (scheduled at 2022-11-28 07:37:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:37:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:37:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:37:24,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 07:37:24,501 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:37:24,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:37:24,513 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:37:24,523 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:37:24,528 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:37:24,562 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:37:24,571 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) notificationworker stdout | 2022-11-28 07:37:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:42 UTC)" (scheduled at 2022-11-28 07:37:32.901291+00:00) notificationworker stdout | 2022-11-28 07:37:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:37:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:33 UTC)" (scheduled at 2022-11-28 07:37:33.026570+00:00) notificationworker stdout | 2022-11-28 07:37:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:37:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:33 UTC)" (scheduled at 2022-11-28 07:37:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:37:33,372 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:37:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:07 UTC)" (scheduled at 2022-11-28 07:37:37.716126+00:00) securityworker stdout | 2022-11-28 07:37:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:37:37,840 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:37:37,841 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:37:39,482 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:37:39,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:37:39,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:37:39,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 07:37:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:37:39,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 07:37:39,575 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) gunicorn-web stdout | 2022-11-28 07:37:39,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:37:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:52 UTC)" (scheduled at 2022-11-28 07:37:42.901291+00:00) notificationworker stdout | 2022-11-28 07:37:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:37:52 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:37:44 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.446 635 0.446) gunicorn-registry stdout | 2022-11-28 07:37:44,600 [246] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:37:44 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:45 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.157 1652 0.157) gunicorn-registry stdout | 2022-11-28 07:37:45,048 [243] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:37:45 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:37:45,160 [246] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:37:45,173 [246] [INFO] [gunicorn.access] - - [28/Nov/2022:07:37:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.105 1631 0.105) gunicorn-registry stdout | 2022-11-28 07:37:45,236 [244] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:37:45,237 [244] [INFO] [gunicorn.access] - - [28/Nov/2022:07:37:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:37:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.035 1631 0.035) securityworker stdout | 2022-11-28 07:37:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:15 UTC)" (scheduled at 2022-11-28 07:37:45.911636+00:00) securityworker stdout | 2022-11-28 07:37:45,948 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:37:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:17 UTC)" (scheduled at 2022-11-28 07:37:47.016425+00:00) gcworker stdout | 2022-11-28 07:37:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:37:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:50 UTC)" (scheduled at 2022-11-28 07:37:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:37:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:37:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:51 UTC)" (scheduled at 2022-11-28 07:37:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:37:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:37:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:02 UTC)" (scheduled at 2022-11-28 07:37:52.901291+00:00) notificationworker stdout | 2022-11-28 07:37:52,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:37:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:23 UTC)" (scheduled at 2022-11-28 07:37:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:37:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:37:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:37:54,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 07:37:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:37:54,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:37:54,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:37:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:37:54,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:37:54,541 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) securityscanningnotificationworker stdout | 2022-11-28 07:37:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:56 UTC)" (scheduled at 2022-11-28 07:37:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:37:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:37:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:57 UTC)" (scheduled at 2022-11-28 07:37:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:37:57,561 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:38:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:38:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:12 UTC)" (scheduled at 2022-11-28 07:38:02.901291+00:00) notificationworker stdout | 2022-11-28 07:38:02,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:38:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:03 UTC)" (scheduled at 2022-11-28 07:38:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:38:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:38:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:06 UTC)" (scheduled at 2022-11-28 07:38:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:38:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:38:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:37 UTC)" (scheduled at 2022-11-28 07:38:07.716126+00:00) securityworker stdout | 2022-11-28 07:38:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:38:07,850 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:38:07,851 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:38:09,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:38:09,502 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:38:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:09,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:38:09,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:38:09,538 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:38:09,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 07:38:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:22 UTC)" (scheduled at 2022-11-28 07:38:12.901291+00:00) notificationworker stdout | 2022-11-28 07:38:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:38:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:15 UTC)" (scheduled at 2022-11-28 07:38:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:38:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:38:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:45 UTC)" (scheduled at 2022-11-28 07:38:15.911636+00:00) securityworker stdout | 2022-11-28 07:38:15,987 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:38:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:47 UTC)" (scheduled at 2022-11-28 07:38:17.016425+00:00) gcworker stdout | 2022-11-28 07:38:17,126 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:38:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:32 UTC)" (scheduled at 2022-11-28 07:38:22.901291+00:00) notificationworker stdout | 2022-11-28 07:38:22,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:38:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:53 UTC)" (scheduled at 2022-11-28 07:38:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:38:23,157 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:38:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:38:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:38:24,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:38:24,515 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:24,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:38:24,518 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:24,522 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:38:24,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 07:38:24,577 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) notificationworker stdout | 2022-11-28 07:38:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:42 UTC)" (scheduled at 2022-11-28 07:38:32.901291+00:00) notificationworker stdout | 2022-11-28 07:38:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:38:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:33 UTC)" (scheduled at 2022-11-28 07:38:33.026570+00:00) notificationworker stdout | 2022-11-28 07:38:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:38:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:33 UTC)" (scheduled at 2022-11-28 07:38:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:38:33,364 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:38:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:07 UTC)" (scheduled at 2022-11-28 07:38:37.716126+00:00) securityworker stdout | 2022-11-28 07:38:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:38:37,763 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:38:37,764 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:38:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:43:38 UTC)" (scheduled at 2022-11-28 07:38:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:38:38,457 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:43:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:38:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:38:39,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:38:39,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:39,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:38:39,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 07:38:39,532 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:38:39,535 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) notificationworker stdout | 2022-11-28 07:38:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:52 UTC)" (scheduled at 2022-11-28 07:38:42.901291+00:00) notificationworker stdout | 2022-11-28 07:38:42,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:38:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:38:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:15 UTC)" (scheduled at 2022-11-28 07:38:45.911636+00:00) securityworker stdout | 2022-11-28 07:38:45,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:38:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:17 UTC)" (scheduled at 2022-11-28 07:38:47.016425+00:00) gcworker stdout | 2022-11-28 07:38:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:38:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:43:49 UTC)" (scheduled at 2022-11-28 07:38:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:38:49,436 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:43:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:38:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:50 UTC)" (scheduled at 2022-11-28 07:38:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:38:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:38:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:51 UTC)" (scheduled at 2022-11-28 07:38:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:38:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:38:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:02 UTC)" (scheduled at 2022-11-28 07:38:52.901291+00:00) notificationworker stdout | 2022-11-28 07:38:52,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:38:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:23 UTC)" (scheduled at 2022-11-28 07:38:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:38:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:38:54,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:38:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:38:54,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:38:54,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:38:54,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:38:54,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:38:54,537 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:38:54,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) securityscanningnotificationworker stdout | 2022-11-28 07:38:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:56 UTC)" (scheduled at 2022-11-28 07:38:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:38:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:38:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:57 UTC)" (scheduled at 2022-11-28 07:38:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:38:57,577 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:39:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:39:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:12 UTC)" (scheduled at 2022-11-28 07:39:02.901291+00:00) notificationworker stdout | 2022-11-28 07:39:02,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:39:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:03 UTC)" (scheduled at 2022-11-28 07:39:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:39:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:39:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:06 UTC)" (scheduled at 2022-11-28 07:39:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:39:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:39:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:37 UTC)" (scheduled at 2022-11-28 07:39:07.716126+00:00) securityworker stdout | 2022-11-28 07:39:07,922 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:39:08,054 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:39:08,054 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:37 UTC)" executed successfully manifestbackfillworker stdout | 2022-11-28 07:39:08,423 [72] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 08:39:08 UTC)" (scheduled at 2022-11-28 07:39:08.421529+00:00) manifestbackfillworker stdout | 2022-11-28 07:39:08,460 [72] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 08:39:08 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:39:09,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:39:09,496 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:39:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:09,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:39:09,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:09,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:39:09,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:39:09,564 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.095) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.095) notificationworker stdout | 2022-11-28 07:39:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:22 UTC)" (scheduled at 2022-11-28 07:39:12.901291+00:00) notificationworker stdout | 2022-11-28 07:39:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:39:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:15 UTC)" (scheduled at 2022-11-28 07:39:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:39:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:39:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:45 UTC)" (scheduled at 2022-11-28 07:39:15.911636+00:00) securityworker stdout | 2022-11-28 07:39:15,970 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:39:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:47 UTC)" (scheduled at 2022-11-28 07:39:17.016425+00:00) gcworker stdout | 2022-11-28 07:39:17,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:39:22,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:32 UTC)" (scheduled at 2022-11-28 07:39:22.901291+00:00) notificationworker stdout | 2022-11-28 07:39:22,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:39:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:53 UTC)" (scheduled at 2022-11-28 07:39:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:39:23,137 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:39:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:39:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:39:24,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:39:24,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:24,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:39:24,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:39:24,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:39:24,558 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:39:24,561 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:39:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:42 UTC)" (scheduled at 2022-11-28 07:39:32.901291+00:00) notificationworker stdout | 2022-11-28 07:39:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:39:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:33 UTC)" (scheduled at 2022-11-28 07:39:33.026570+00:00) notificationworker stdout | 2022-11-28 07:39:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:39:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:33 UTC)" (scheduled at 2022-11-28 07:39:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:39:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:39:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:07 UTC)" (scheduled at 2022-11-28 07:39:37.716126+00:00) securityworker stdout | 2022-11-28 07:39:37,741 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:39:37,833 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:39:37,834 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:39:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:44:38 UTC)" (scheduled at 2022-11-28 07:39:38.024004+00:00) notificationworker stdout | 2022-11-28 07:39:38,100 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:44:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:39:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:39:39,498 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:39:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:39,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:39:39,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:39:39,519 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 07:39:39,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:39:39,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) notificationworker stdout | 2022-11-28 07:39:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:52 UTC)" (scheduled at 2022-11-28 07:39:42.901291+00:00) notificationworker stdout | 2022-11-28 07:39:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:39:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:39:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:15 UTC)" (scheduled at 2022-11-28 07:39:45.911636+00:00) securityworker stdout | 2022-11-28 07:39:45,955 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:39:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:17 UTC)" (scheduled at 2022-11-28 07:39:47.016425+00:00) gcworker stdout | 2022-11-28 07:39:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:39:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:50 UTC)" (scheduled at 2022-11-28 07:39:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:39:50,160 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:39:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:51 UTC)" (scheduled at 2022-11-28 07:39:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:39:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:39:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:02 UTC)" (scheduled at 2022-11-28 07:39:52.901291+00:00) notificationworker stdout | 2022-11-28 07:39:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:39:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:23 UTC)" (scheduled at 2022-11-28 07:39:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:39:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:39:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:39:54,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:39:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:39:54,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:39:54,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:39:54,541 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 07:39:54,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) securityscanningnotificationworker stdout | 2022-11-28 07:39:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:56 UTC)" (scheduled at 2022-11-28 07:39:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:39:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:39:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:57 UTC)" (scheduled at 2022-11-28 07:39:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:39:57,566 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:40:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:40:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:12 UTC)" (scheduled at 2022-11-28 07:40:02.901291+00:00) notificationworker stdout | 2022-11-28 07:40:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:40:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:03 UTC)" (scheduled at 2022-11-28 07:40:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:40:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:40:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:06 UTC)" (scheduled at 2022-11-28 07:40:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:40:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:40:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:37 UTC)" (scheduled at 2022-11-28 07:40:07.716126+00:00) securityworker stdout | 2022-11-28 07:40:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:40:07,759 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:40:07,760 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:40:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:40:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:40:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 07:40:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:09,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 07:40:09,542 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 07:40:09,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:40:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:22 UTC)" (scheduled at 2022-11-28 07:40:12.901291+00:00) notificationworker stdout | 2022-11-28 07:40:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:40:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:15 UTC)" (scheduled at 2022-11-28 07:40:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:40:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:40:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:45 UTC)" (scheduled at 2022-11-28 07:40:15.911636+00:00) securityworker stdout | 2022-11-28 07:40:15,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:40:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:47 UTC)" (scheduled at 2022-11-28 07:40:17.016425+00:00) gcworker stdout | 2022-11-28 07:40:17,143 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:40:22,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:32 UTC)" (scheduled at 2022-11-28 07:40:22.901291+00:00) notificationworker stdout | 2022-11-28 07:40:22,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:40:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:53 UTC)" (scheduled at 2022-11-28 07:40:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:40:23,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:40:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:40:24,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:40:24,500 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:40:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:24,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:40:24,530 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:24,535 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:40:24,556 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) gunicorn-web stdout | 2022-11-28 07:40:24,590 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:40:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:42 UTC)" (scheduled at 2022-11-28 07:40:32.901291+00:00) notificationworker stdout | 2022-11-28 07:40:32,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:40:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:33 UTC)" (scheduled at 2022-11-28 07:40:33.026570+00:00) notificationworker stdout | 2022-11-28 07:40:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:40:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:33 UTC)" (scheduled at 2022-11-28 07:40:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:40:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:40:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:07 UTC)" (scheduled at 2022-11-28 07:40:37.716126+00:00) securityworker stdout | 2022-11-28 07:40:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:40:37,772 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:40:37,774 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 07:40:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:40:39,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:40:39,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:39,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:40:39,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:40:39,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 07:40:39,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 07:40:39,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:40:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:45:41 UTC)" (scheduled at 2022-11-28 07:40:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:40:41,218 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:45:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:40:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:52 UTC)" (scheduled at 2022-11-28 07:40:42.901291+00:00) notificationworker stdout | 2022-11-28 07:40:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:40:52 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:40:45,370 [247] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:40:45 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:40:45 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.008 487 0.008) securityworker stdout | 2022-11-28 07:40:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:15 UTC)" (scheduled at 2022-11-28 07:40:45.911636+00:00) securityworker stdout | 2022-11-28 07:40:45,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:15 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:40:45 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.595 635 0.594) gunicorn-registry stdout | 2022-11-28 07:40:45,982 [247] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:40:45 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:40:46 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.077 1652 0.077) gunicorn-registry stdout | 2022-11-28 07:40:46,088 [244] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:40:46 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:40:46,144 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:40:46,146 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:07:40:46 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:40:46 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.031 1631 0.031) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:40:46 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.025 1652 0.025) gunicorn-registry stdout | 2022-11-28 07:40:46,411 [244] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:40:46 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gcworker stdout | 2022-11-28 07:40:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:17 UTC)" (scheduled at 2022-11-28 07:40:47.016425+00:00) gcworker stdout | 2022-11-28 07:40:47,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:40:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:45:48 UTC)" (scheduled at 2022-11-28 07:40:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:40:48,086 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:45:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:40:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:50 UTC)" (scheduled at 2022-11-28 07:40:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:40:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:40:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:51 UTC)" (scheduled at 2022-11-28 07:40:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:40:51,793 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:40:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:02 UTC)" (scheduled at 2022-11-28 07:40:52.901291+00:00) notificationworker stdout | 2022-11-28 07:40:52,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:40:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:23 UTC)" (scheduled at 2022-11-28 07:40:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:40:53,182 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:40:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:40:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 07:40:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:40:54,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:40:54,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.077) gunicorn-web stdout | 2022-11-28 07:40:54,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 07:40:54,556 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:40:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:56 UTC)" (scheduled at 2022-11-28 07:40:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:40:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:40:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:57 UTC)" (scheduled at 2022-11-28 07:40:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:40:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:41:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:41:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:12 UTC)" (scheduled at 2022-11-28 07:41:02.901291+00:00) notificationworker stdout | 2022-11-28 07:41:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:41:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:03 UTC)" (scheduled at 2022-11-28 07:41:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:41:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:41:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:06 UTC)" (scheduled at 2022-11-28 07:41:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:41:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:41:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:37 UTC)" (scheduled at 2022-11-28 07:41:07.716126+00:00) securityworker stdout | 2022-11-28 07:41:07,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:41:07,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:41:07,806 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:41:09,482 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:41:09,483 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:41:09,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:09,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:41:09,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:41:09,538 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 07:41:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:41:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:22 UTC)" (scheduled at 2022-11-28 07:41:12.901291+00:00) notificationworker stdout | 2022-11-28 07:41:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:41:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:15 UTC)" (scheduled at 2022-11-28 07:41:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:41:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:41:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:45 UTC)" (scheduled at 2022-11-28 07:41:15.911636+00:00) securityworker stdout | 2022-11-28 07:41:15,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:41:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:47 UTC)" (scheduled at 2022-11-28 07:41:17.016425+00:00) gcworker stdout | 2022-11-28 07:41:17,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:41:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:32 UTC)" (scheduled at 2022-11-28 07:41:22.901291+00:00) notificationworker stdout | 2022-11-28 07:41:22,976 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:41:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:53 UTC)" (scheduled at 2022-11-28 07:41:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:41:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:41:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:41:24,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 07:41:24,500 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:24,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:41:24,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:41:24,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) gunicorn-web stdout | 2022-11-28 07:41:24,580 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 07:41:24,589 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:41:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:42 UTC)" (scheduled at 2022-11-28 07:41:32.901291+00:00) notificationworker stdout | 2022-11-28 07:41:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:41:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:33 UTC)" (scheduled at 2022-11-28 07:41:33.026570+00:00) notificationworker stdout | 2022-11-28 07:41:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:41:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:33 UTC)" (scheduled at 2022-11-28 07:41:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:41:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:41:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:07 UTC)" (scheduled at 2022-11-28 07:41:37.716126+00:00) securityworker stdout | 2022-11-28 07:41:37,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:41:37,821 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:41:37,822 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:41:39,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:41:39,495 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:41:39,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:41:39,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 07:41:39,517 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.169 118 0.169) gunicorn-web stdout | 2022-11-28 07:41:39,641 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.169 118 0.169) gunicorn-web stdout | 2022-11-28 07:41:39,642 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:41:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:52 UTC)" (scheduled at 2022-11-28 07:41:42.901291+00:00) notificationworker stdout | 2022-11-28 07:41:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:41:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:41:45,917 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:15 UTC)" (scheduled at 2022-11-28 07:41:45.911636+00:00) securityworker stdout | 2022-11-28 07:41:46,040 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:41:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:17 UTC)" (scheduled at 2022-11-28 07:41:47.016425+00:00) gcworker stdout | 2022-11-28 07:41:47,111 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:41:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:50 UTC)" (scheduled at 2022-11-28 07:41:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:41:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:41:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:51 UTC)" (scheduled at 2022-11-28 07:41:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:41:51,795 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:41:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:02 UTC)" (scheduled at 2022-11-28 07:41:52.901291+00:00) notificationworker stdout | 2022-11-28 07:41:52,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:41:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:23 UTC)" (scheduled at 2022-11-28 07:41:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:41:53,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:41:54,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:41:54,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:41:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:41:54,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:41:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.218 118 0.218) gunicorn-web stdout | 2022-11-28 07:41:54,691 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:41:54,713 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.239 118 0.239) securityscanningnotificationworker stdout | 2022-11-28 07:41:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:56 UTC)" (scheduled at 2022-11-28 07:41:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:41:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:41:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:57 UTC)" (scheduled at 2022-11-28 07:41:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:41:57,602 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:42:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:42:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:12 UTC)" (scheduled at 2022-11-28 07:42:02.901291+00:00) notificationworker stdout | 2022-11-28 07:42:02,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:42:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:03 UTC)" (scheduled at 2022-11-28 07:42:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:42:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:42:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:06 UTC)" (scheduled at 2022-11-28 07:42:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:42:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:42:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:37 UTC)" (scheduled at 2022-11-28 07:42:07.716126+00:00) securityworker stdout | 2022-11-28 07:42:07,719 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:42:07,865 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:42:07,866 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:42:09,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:42:09,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:42:09,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:09,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:42:09,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:42:09,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:42:09,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) notificationworker stdout | 2022-11-28 07:42:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:22 UTC)" (scheduled at 2022-11-28 07:42:12.901291+00:00) notificationworker stdout | 2022-11-28 07:42:12,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:42:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:15 UTC)" (scheduled at 2022-11-28 07:42:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:42:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:42:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:45 UTC)" (scheduled at 2022-11-28 07:42:15.911636+00:00) securityworker stdout | 2022-11-28 07:42:15,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:42:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:47 UTC)" (scheduled at 2022-11-28 07:42:17.016425+00:00) gcworker stdout | 2022-11-28 07:42:17,197 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:42:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:32 UTC)" (scheduled at 2022-11-28 07:42:22.901291+00:00) notificationworker stdout | 2022-11-28 07:42:22,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:42:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:53 UTC)" (scheduled at 2022-11-28 07:42:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:42:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:42:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:42:24,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:42:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:24,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:42:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:42:24,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:24,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.127 118 0.127) gunicorn-web stdout | 2022-11-28 07:42:24,601 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:42:24,615 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.139 118 0.139) notificationworker stdout | 2022-11-28 07:42:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:42 UTC)" (scheduled at 2022-11-28 07:42:32.901291+00:00) notificationworker stdout | 2022-11-28 07:42:32,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:42:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:33 UTC)" (scheduled at 2022-11-28 07:42:33.026570+00:00) notificationworker stdout | 2022-11-28 07:42:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:42:33,326 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:33 UTC)" (scheduled at 2022-11-28 07:42:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:42:33,400 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:42:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:07 UTC)" (scheduled at 2022-11-28 07:42:37.716126+00:00) securityworker stdout | 2022-11-28 07:42:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:42:37,790 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:42:37,791 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:42:39,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:42:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:42:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:42:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:42:39,590 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) gunicorn-web stdout | 2022-11-28 07:42:39,597 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:42:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:52 UTC)" (scheduled at 2022-11-28 07:42:42.901291+00:00) notificationworker stdout | 2022-11-28 07:42:42,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:42:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:42:45,919 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:15 UTC)" (scheduled at 2022-11-28 07:42:45.911636+00:00) securityworker stdout | 2022-11-28 07:42:46,009 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:42:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:17 UTC)" (scheduled at 2022-11-28 07:42:47.016425+00:00) gcworker stdout | 2022-11-28 07:42:47,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:42:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:50 UTC)" (scheduled at 2022-11-28 07:42:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:42:50,178 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:42:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:51 UTC)" (scheduled at 2022-11-28 07:42:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:42:51,807 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:42:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:02 UTC)" (scheduled at 2022-11-28 07:42:52.901291+00:00) notificationworker stdout | 2022-11-28 07:42:52,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:42:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:23 UTC)" (scheduled at 2022-11-28 07:42:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:42:53,184 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:42:54,504 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:54,520 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 07:42:54,523 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 07:42:54,528 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:42:54,542 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:42:54,548 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:42:54,657 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.180 118 0.180) gunicorn-web stdout | 2022-11-28 07:42:54,736 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.260 118 0.259) securityscanningnotificationworker stdout | 2022-11-28 07:42:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:56 UTC)" (scheduled at 2022-11-28 07:42:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:42:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:42:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:57 UTC)" (scheduled at 2022-11-28 07:42:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:42:57,621 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:43:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:43:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:12 UTC)" (scheduled at 2022-11-28 07:43:02.901291+00:00) notificationworker stdout | 2022-11-28 07:43:02,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:43:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:03 UTC)" (scheduled at 2022-11-28 07:43:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:43:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:43:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:06 UTC)" (scheduled at 2022-11-28 07:43:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:43:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:43:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:37 UTC)" (scheduled at 2022-11-28 07:43:07.716126+00:00) securityworker stdout | 2022-11-28 07:43:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:43:07,876 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:43:07,877 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:43:09,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:43:09,487 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:43:09,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:43:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:43:09,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:09,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 07:43:09,533 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:43:09,539 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 07:43:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:22 UTC)" (scheduled at 2022-11-28 07:43:12.901291+00:00) notificationworker stdout | 2022-11-28 07:43:12,984 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:43:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:15 UTC)" (scheduled at 2022-11-28 07:43:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:43:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:43:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:45 UTC)" (scheduled at 2022-11-28 07:43:15.911636+00:00) securityworker stdout | 2022-11-28 07:43:16,089 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:43:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:47 UTC)" (scheduled at 2022-11-28 07:43:17.016425+00:00) gcworker stdout | 2022-11-28 07:43:17,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:43:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:32 UTC)" (scheduled at 2022-11-28 07:43:22.901291+00:00) notificationworker stdout | 2022-11-28 07:43:22,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:43:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:53 UTC)" (scheduled at 2022-11-28 07:43:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:43:23,178 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:43:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:43:24,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:43:24,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:43:24,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:43:24,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:24,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:43:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:24,575 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.143 118 0.143) gunicorn-web stdout | 2022-11-28 07:43:24,618 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:43:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:42 UTC)" (scheduled at 2022-11-28 07:43:32.901291+00:00) notificationworker stdout | 2022-11-28 07:43:32,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:43:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:33 UTC)" (scheduled at 2022-11-28 07:43:33.026570+00:00) notificationworker stdout | 2022-11-28 07:43:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:43:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:33 UTC)" (scheduled at 2022-11-28 07:43:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:43:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:43:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:07 UTC)" (scheduled at 2022-11-28 07:43:37.716126+00:00) securityworker stdout | 2022-11-28 07:43:37,745 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:43:37,854 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:43:37,855 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:43:38,421 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:48:38 UTC)" (scheduled at 2022-11-28 07:43:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:43:38,540 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:48:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:43:39,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:43:39,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:43:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:43:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:39,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:43:39,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:39,593 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 07:43:39,602 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:43:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:52 UTC)" (scheduled at 2022-11-28 07:43:42.901291+00:00) notificationworker stdout | 2022-11-28 07:43:42,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:43:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:43:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:15 UTC)" (scheduled at 2022-11-28 07:43:45.911636+00:00) securityworker stdout | 2022-11-28 07:43:45,999 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:43:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:17 UTC)" (scheduled at 2022-11-28 07:43:47.016425+00:00) gcworker stdout | 2022-11-28 07:43:47,104 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:43:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:48:49 UTC)" (scheduled at 2022-11-28 07:43:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:43:49,489 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:48:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:43:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:50 UTC)" (scheduled at 2022-11-28 07:43:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:43:50,189 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:43:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:51 UTC)" (scheduled at 2022-11-28 07:43:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:43:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:43:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:02 UTC)" (scheduled at 2022-11-28 07:43:52.901291+00:00) notificationworker stdout | 2022-11-28 07:43:52,996 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:43:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:23 UTC)" (scheduled at 2022-11-28 07:43:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:43:53,250 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:43:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:43:54,493 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-web stdout | 2022-11-28 07:43:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:43:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:43:54,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:43:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:43:54,612 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) gunicorn-web stdout | 2022-11-28 07:43:54,630 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.157 118 0.157) securityscanningnotificationworker stdout | 2022-11-28 07:43:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:56 UTC)" (scheduled at 2022-11-28 07:43:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:43:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:43:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:57 UTC)" (scheduled at 2022-11-28 07:43:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:43:57,559 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:44:57 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:43:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.010 487 0.010) gunicorn-registry stdout | 2022-11-28 07:43:57,978 [244] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:43:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:43:59 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.056 1652 0.055) gunicorn-registry stdout | 2022-11-28 07:43:59,385 [245] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:43:59 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:43:59,466 [246] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:43:59,467 [246] [INFO] [gunicorn.access] - - [28/Nov/2022:07:43:59 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:43:59 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.052 1631 0.052) notificationworker stdout | 2022-11-28 07:44:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:12 UTC)" (scheduled at 2022-11-28 07:44:02.901291+00:00) notificationworker stdout | 2022-11-28 07:44:02,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:44:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:03 UTC)" (scheduled at 2022-11-28 07:44:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:44:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:44:06,426 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:06 UTC)" (scheduled at 2022-11-28 07:44:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:44:06,427 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:44:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:37 UTC)" (scheduled at 2022-11-28 07:44:07.716126+00:00) securityworker stdout | 2022-11-28 07:44:07,776 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:44:07,867 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:44:07,867 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:44:09,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:44:09,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:44:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:09,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:44:09,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 07:44:09,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.121 118 0.121) gunicorn-web stdout | 2022-11-28 07:44:09,592 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:44:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:22 UTC)" (scheduled at 2022-11-28 07:44:12.901291+00:00) notificationworker stdout | 2022-11-28 07:44:12,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:44:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:15 UTC)" (scheduled at 2022-11-28 07:44:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:44:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:44:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:45 UTC)" (scheduled at 2022-11-28 07:44:15.911636+00:00) securityworker stdout | 2022-11-28 07:44:16,018 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:44:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:47 UTC)" (scheduled at 2022-11-28 07:44:17.016425+00:00) gcworker stdout | 2022-11-28 07:44:17,096 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:44:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:32 UTC)" (scheduled at 2022-11-28 07:44:22.901291+00:00) notificationworker stdout | 2022-11-28 07:44:22,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:44:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:53 UTC)" (scheduled at 2022-11-28 07:44:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:44:23,177 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:44:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:44:24,483 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:44:24,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:24,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:44:24,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:44:24,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:24,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:44:24,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 07:44:24,573 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) notificationworker stdout | 2022-11-28 07:44:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:42 UTC)" (scheduled at 2022-11-28 07:44:32.901291+00:00) notificationworker stdout | 2022-11-28 07:44:32,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:44:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:33 UTC)" (scheduled at 2022-11-28 07:44:33.026570+00:00) notificationworker stdout | 2022-11-28 07:44:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:44:33,326 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:33 UTC)" (scheduled at 2022-11-28 07:44:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:44:33,369 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:44:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:07 UTC)" (scheduled at 2022-11-28 07:44:37.716126+00:00) securityworker stdout | 2022-11-28 07:44:37,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:44:37,802 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:44:37,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:44:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:49:38 UTC)" (scheduled at 2022-11-28 07:44:38.024004+00:00) notificationworker stdout | 2022-11-28 07:44:38,072 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:49:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 07:44:39,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:44:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:39,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:44:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:44:39,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 07:44:39,563 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:44:39,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:44:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:52 UTC)" (scheduled at 2022-11-28 07:44:42.901291+00:00) notificationworker stdout | 2022-11-28 07:44:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:44:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:44:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:15 UTC)" (scheduled at 2022-11-28 07:44:45.911636+00:00) securityworker stdout | 2022-11-28 07:44:45,994 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:44:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:17 UTC)" (scheduled at 2022-11-28 07:44:47.016425+00:00) gcworker stdout | 2022-11-28 07:44:47,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:44:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:50 UTC)" (scheduled at 2022-11-28 07:44:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:44:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:44:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:51 UTC)" (scheduled at 2022-11-28 07:44:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:44:51,765 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:44:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:02 UTC)" (scheduled at 2022-11-28 07:44:52.901291+00:00) notificationworker stdout | 2022-11-28 07:44:52,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:44:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:23 UTC)" (scheduled at 2022-11-28 07:44:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:44:53,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:44:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-registry stdout | 2022-11-28 07:44:54,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:54,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:44:54,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:44:54,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:44:54,588 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 07:44:54,601 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:44:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:56 UTC)" (scheduled at 2022-11-28 07:44:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:44:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:44:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:57 UTC)" (scheduled at 2022-11-28 07:44:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:44:57,620 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:45:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:45:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:12 UTC)" (scheduled at 2022-11-28 07:45:02.901291+00:00) notificationworker stdout | 2022-11-28 07:45:02,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:45:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:03 UTC)" (scheduled at 2022-11-28 07:45:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:45:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:45:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:06 UTC)" (scheduled at 2022-11-28 07:45:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:45:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:45:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:37 UTC)" (scheduled at 2022-11-28 07:45:07.716126+00:00) securityworker stdout | 2022-11-28 07:45:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:45:07,823 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:45:07,824 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:45:09,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:45:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:45:09,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:45:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:45:09,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:45:09,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:09,576 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 07:45:09,604 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) notificationworker stdout | 2022-11-28 07:45:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:22 UTC)" (scheduled at 2022-11-28 07:45:12.901291+00:00) notificationworker stdout | 2022-11-28 07:45:13,042 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:45:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:15 UTC)" (scheduled at 2022-11-28 07:45:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:45:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:45:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:45 UTC)" (scheduled at 2022-11-28 07:45:15.911636+00:00) securityworker stdout | 2022-11-28 07:45:15,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:45:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:47 UTC)" (scheduled at 2022-11-28 07:45:17.016425+00:00) gcworker stdout | 2022-11-28 07:45:17,175 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:45:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:32 UTC)" (scheduled at 2022-11-28 07:45:22.901291+00:00) notificationworker stdout | 2022-11-28 07:45:22,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:45:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:53 UTC)" (scheduled at 2022-11-28 07:45:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:45:23,221 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:45:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:45:24,503 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-web stdout | 2022-11-28 07:45:24,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.003) gunicorn-web stdout | 2022-11-28 07:45:24,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:24,515 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-registry stdout | 2022-11-28 07:45:24,515 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:45:24,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:24,617 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) gunicorn-web stdout | 2022-11-28 07:45:24,624 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.152 118 0.151) notificationworker stdout | 2022-11-28 07:45:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:42 UTC)" (scheduled at 2022-11-28 07:45:32.901291+00:00) notificationworker stdout | 2022-11-28 07:45:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:45:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:33 UTC)" (scheduled at 2022-11-28 07:45:33.026570+00:00) notificationworker stdout | 2022-11-28 07:45:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:45:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:33 UTC)" (scheduled at 2022-11-28 07:45:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:45:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:45:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:07 UTC)" (scheduled at 2022-11-28 07:45:37.716126+00:00) securityworker stdout | 2022-11-28 07:45:37,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:45:37,844 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:45:37,845 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:45:39,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:45:39,494 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 07:45:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:45:39,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:45:39,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:39,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:39,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.138) gunicorn-web stdout | 2022-11-28 07:45:39,617 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:45:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:50:41 UTC)" (scheduled at 2022-11-28 07:45:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:45:41,245 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:50:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:45:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:52 UTC)" (scheduled at 2022-11-28 07:45:42.901291+00:00) notificationworker stdout | 2022-11-28 07:45:42,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:45:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:45:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:15 UTC)" (scheduled at 2022-11-28 07:45:45.911636+00:00) securityworker stdout | 2022-11-28 07:45:46,101 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:45:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:17 UTC)" (scheduled at 2022-11-28 07:45:47.016425+00:00) gcworker stdout | 2022-11-28 07:45:47,162 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:45:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:50:48 UTC)" (scheduled at 2022-11-28 07:45:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:45:48,092 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:50:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:45:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:50 UTC)" (scheduled at 2022-11-28 07:45:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:45:50,158 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:45:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:51 UTC)" (scheduled at 2022-11-28 07:45:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:45:51,866 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:45:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:02 UTC)" (scheduled at 2022-11-28 07:45:52.901291+00:00) notificationworker stdout | 2022-11-28 07:45:53,001 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:45:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:23 UTC)" (scheduled at 2022-11-28 07:45:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:45:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:45:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:45:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 07:45:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:45:54,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:45:54,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:45:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:45:54,636 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.164 118 0.164) gunicorn-web stdout | 2022-11-28 07:45:54,641 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.170 118 0.171) securityscanningnotificationworker stdout | 2022-11-28 07:45:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:56 UTC)" (scheduled at 2022-11-28 07:45:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:45:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:45:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:57 UTC)" (scheduled at 2022-11-28 07:45:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:45:57,589 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:46:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:46:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:12 UTC)" (scheduled at 2022-11-28 07:46:02.901291+00:00) notificationworker stdout | 2022-11-28 07:46:02,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:46:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:03 UTC)" (scheduled at 2022-11-28 07:46:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:46:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:46:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:06 UTC)" (scheduled at 2022-11-28 07:46:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:46:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:46:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:37 UTC)" (scheduled at 2022-11-28 07:46:07.716126+00:00) securityworker stdout | 2022-11-28 07:46:07,836 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:46:08,106 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:46:08,109 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:46:09,507 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:09,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:46:09,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:09,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.008) gunicorn-registry stdout | 2022-11-28 07:46:09,519 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:09,520 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) gunicorn-web stdout | 2022-11-28 07:46:09,622 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.159 118 0.159) gunicorn-web stdout | 2022-11-28 07:46:09,642 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:46:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:22 UTC)" (scheduled at 2022-11-28 07:46:12.901291+00:00) notificationworker stdout | 2022-11-28 07:46:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:46:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:15 UTC)" (scheduled at 2022-11-28 07:46:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:46:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:46:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:45 UTC)" (scheduled at 2022-11-28 07:46:15.911636+00:00) securityworker stdout | 2022-11-28 07:46:15,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:46:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:47 UTC)" (scheduled at 2022-11-28 07:46:17.016425+00:00) gcworker stdout | 2022-11-28 07:46:17,055 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:46:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:32 UTC)" (scheduled at 2022-11-28 07:46:22.901291+00:00) notificationworker stdout | 2022-11-28 07:46:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:46:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:53 UTC)" (scheduled at 2022-11-28 07:46:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:46:23,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:46:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) gunicorn-registry stdout | 2022-11-28 07:46:24,521 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.041 162 0.042) gunicorn-registry stdout | 2022-11-28 07:46:24,538 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:24,543 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:46:24,545 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:46:24,548 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.004) gunicorn-web stdout | 2022-11-28 07:46:24,553 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.158) gunicorn-web stdout | 2022-11-28 07:46:24,633 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:46:24,705 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.230 118 0.230) notificationworker stdout | 2022-11-28 07:46:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:42 UTC)" (scheduled at 2022-11-28 07:46:32.901291+00:00) notificationworker stdout | 2022-11-28 07:46:32,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:46:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:33 UTC)" (scheduled at 2022-11-28 07:46:33.026570+00:00) notificationworker stdout | 2022-11-28 07:46:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:46:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:33 UTC)" (scheduled at 2022-11-28 07:46:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:46:33,375 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:46:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:07 UTC)" (scheduled at 2022-11-28 07:46:37.716126+00:00) securityworker stdout | 2022-11-28 07:46:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:46:37,806 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:46:37,807 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:46:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:46:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:46:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:46:39,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:46:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 07:46:39,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:46:39,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) notificationworker stdout | 2022-11-28 07:46:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:52 UTC)" (scheduled at 2022-11-28 07:46:42.901291+00:00) notificationworker stdout | 2022-11-28 07:46:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:46:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:46:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:15 UTC)" (scheduled at 2022-11-28 07:46:45.911636+00:00) securityworker stdout | 2022-11-28 07:46:45,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:46:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:17 UTC)" (scheduled at 2022-11-28 07:46:47.016425+00:00) gcworker stdout | 2022-11-28 07:46:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:46:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:50 UTC)" (scheduled at 2022-11-28 07:46:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:46:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:46:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:51 UTC)" (scheduled at 2022-11-28 07:46:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:46:51,800 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:46:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:02 UTC)" (scheduled at 2022-11-28 07:46:52.901291+00:00) notificationworker stdout | 2022-11-28 07:46:52,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:46:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:23 UTC)" (scheduled at 2022-11-28 07:46:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:46:53,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:46:54,489 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:46:54,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:46:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:46:54,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:46:54,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:46:54,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 07:46:54,554 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:46:54,559 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) securityscanningnotificationworker stdout | 2022-11-28 07:46:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:56 UTC)" (scheduled at 2022-11-28 07:46:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:46:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:46:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:57 UTC)" (scheduled at 2022-11-28 07:46:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:46:57,622 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:47:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:47:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:12 UTC)" (scheduled at 2022-11-28 07:47:02.901291+00:00) notificationworker stdout | 2022-11-28 07:47:02,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:47:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:03 UTC)" (scheduled at 2022-11-28 07:47:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:47:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:47:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:06 UTC)" (scheduled at 2022-11-28 07:47:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:47:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:47:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:37 UTC)" (scheduled at 2022-11-28 07:47:07.716126+00:00) securityworker stdout | 2022-11-28 07:47:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:47:07,755 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:47:07,756 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:47:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:47:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:47:09,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:47:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:09,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:09,550 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 07:47:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:47:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:22 UTC)" (scheduled at 2022-11-28 07:47:12.901291+00:00) notificationworker stdout | 2022-11-28 07:47:12,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:47:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:15 UTC)" (scheduled at 2022-11-28 07:47:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:47:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:47:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:45 UTC)" (scheduled at 2022-11-28 07:47:15.911636+00:00) securityworker stdout | 2022-11-28 07:47:15,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:47:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:47 UTC)" (scheduled at 2022-11-28 07:47:17.016425+00:00) gcworker stdout | 2022-11-28 07:47:17,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:47:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:32 UTC)" (scheduled at 2022-11-28 07:47:22.901291+00:00) notificationworker stdout | 2022-11-28 07:47:22,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:47:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:53 UTC)" (scheduled at 2022-11-28 07:47:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:47:23,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:47:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:47:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:47:24,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.012) gunicorn-web stdout | 2022-11-28 07:47:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 07:47:24,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:47:24,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:24,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:24,580 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 07:47:24,589 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:47:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:42 UTC)" (scheduled at 2022-11-28 07:47:32.901291+00:00) notificationworker stdout | 2022-11-28 07:47:32,985 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:47:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:33 UTC)" (scheduled at 2022-11-28 07:47:33.026570+00:00) notificationworker stdout | 2022-11-28 07:47:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:47:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:33 UTC)" (scheduled at 2022-11-28 07:47:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:47:33,385 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:47:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:07 UTC)" (scheduled at 2022-11-28 07:47:37.716126+00:00) securityworker stdout | 2022-11-28 07:47:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:47:37,866 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:47:37,867 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:47:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:47:39,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:47:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:47:39,486 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:39,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:39,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:47:39,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:47:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:52 UTC)" (scheduled at 2022-11-28 07:47:42.901291+00:00) notificationworker stdout | 2022-11-28 07:47:43,058 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:47:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:47:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:15 UTC)" (scheduled at 2022-11-28 07:47:45.911636+00:00) securityworker stdout | 2022-11-28 07:47:46,215 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:47:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:17 UTC)" (scheduled at 2022-11-28 07:47:47.016425+00:00) gcworker stdout | 2022-11-28 07:47:47,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:47:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:50 UTC)" (scheduled at 2022-11-28 07:47:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:47:50,220 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:47:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:51 UTC)" (scheduled at 2022-11-28 07:47:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:47:51,854 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:47:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:02 UTC)" (scheduled at 2022-11-28 07:47:52.901291+00:00) notificationworker stdout | 2022-11-28 07:47:53,000 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:47:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:23 UTC)" (scheduled at 2022-11-28 07:47:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:47:53,219 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:47:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:47:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:47:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:47:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:47:54,783 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.311 118 0.311) gunicorn-web stdout | 2022-11-28 07:47:54,843 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.370 118 0.370) securityscanningnotificationworker stdout | 2022-11-28 07:47:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:56 UTC)" (scheduled at 2022-11-28 07:47:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:47:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:47:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:57 UTC)" (scheduled at 2022-11-28 07:47:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:47:57,725 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:48:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:48:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:12 UTC)" (scheduled at 2022-11-28 07:48:02.901291+00:00) notificationworker stdout | 2022-11-28 07:48:02,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:48:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:03 UTC)" (scheduled at 2022-11-28 07:48:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:48:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:48:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:06 UTC)" (scheduled at 2022-11-28 07:48:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:48:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:48:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:37 UTC)" (scheduled at 2022-11-28 07:48:07.716126+00:00) securityworker stdout | 2022-11-28 07:48:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:48:07,860 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:48:07,860 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:48:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:48:09,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:48:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:48:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:48:09,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:48:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 07:48:09,555 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:48:09,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) notificationworker stdout | 2022-11-28 07:48:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:22 UTC)" (scheduled at 2022-11-28 07:48:12.901291+00:00) notificationworker stdout | 2022-11-28 07:48:12,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:48:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:15 UTC)" (scheduled at 2022-11-28 07:48:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:48:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:48:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:45 UTC)" (scheduled at 2022-11-28 07:48:15.911636+00:00) securityworker stdout | 2022-11-28 07:48:16,085 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:48:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:47 UTC)" (scheduled at 2022-11-28 07:48:17.016425+00:00) gcworker stdout | 2022-11-28 07:48:17,156 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:48:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:32 UTC)" (scheduled at 2022-11-28 07:48:22.901291+00:00) notificationworker stdout | 2022-11-28 07:48:22,974 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:48:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:53 UTC)" (scheduled at 2022-11-28 07:48:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:48:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:48:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:48:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:48:24,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:48:24,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:48:24,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:48:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:48:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.174 118 0.174) gunicorn-web stdout | 2022-11-28 07:48:24,645 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:48:24,646 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.174 118 0.174) notificationworker stdout | 2022-11-28 07:48:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:42 UTC)" (scheduled at 2022-11-28 07:48:32.901291+00:00) notificationworker stdout | 2022-11-28 07:48:32,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:48:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:33 UTC)" (scheduled at 2022-11-28 07:48:33.026570+00:00) notificationworker stdout | 2022-11-28 07:48:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:48:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:33 UTC)" (scheduled at 2022-11-28 07:48:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:48:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:48:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:07 UTC)" (scheduled at 2022-11-28 07:48:37.716126+00:00) securityworker stdout | 2022-11-28 07:48:37,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:48:37,790 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:48:37,791 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:48:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:53:38 UTC)" (scheduled at 2022-11-28 07:48:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:48:38,473 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:53:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:48:39,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:48:39,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:48:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:48:39,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:48:39,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:48:39,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 07:48:39,531 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:48:39,531 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) notificationworker stdout | 2022-11-28 07:48:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:52 UTC)" (scheduled at 2022-11-28 07:48:42.901291+00:00) notificationworker stdout | 2022-11-28 07:48:42,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:48:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:48:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:15 UTC)" (scheduled at 2022-11-28 07:48:45.911636+00:00) securityworker stdout | 2022-11-28 07:48:46,023 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:48:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:17 UTC)" (scheduled at 2022-11-28 07:48:47.016425+00:00) gcworker stdout | 2022-11-28 07:48:47,103 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:48:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:53:49 UTC)" (scheduled at 2022-11-28 07:48:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:48:49,504 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:53:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:48:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:50 UTC)" (scheduled at 2022-11-28 07:48:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:48:50,190 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:48:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:51 UTC)" (scheduled at 2022-11-28 07:48:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:48:51,799 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:48:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:02 UTC)" (scheduled at 2022-11-28 07:48:52.901291+00:00) notificationworker stdout | 2022-11-28 07:48:52,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:48:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:23 UTC)" (scheduled at 2022-11-28 07:48:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:48:53,139 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:48:54,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:48:54,502 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:48:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:48:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:48:54,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:48:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.149 118 0.149) gunicorn-web stdout | 2022-11-28 07:48:54,621 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.163 118 0.163) gunicorn-web stdout | 2022-11-28 07:48:54,635 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:48:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:56 UTC)" (scheduled at 2022-11-28 07:48:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:48:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:48:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:57 UTC)" (scheduled at 2022-11-28 07:48:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:48:57,667 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:49:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:49:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:12 UTC)" (scheduled at 2022-11-28 07:49:02.901291+00:00) notificationworker stdout | 2022-11-28 07:49:03,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:49:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:03 UTC)" (scheduled at 2022-11-28 07:49:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:49:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:49:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:06 UTC)" (scheduled at 2022-11-28 07:49:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:49:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:49:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:37 UTC)" (scheduled at 2022-11-28 07:49:07.716126+00:00) securityworker stdout | 2022-11-28 07:49:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:49:07,817 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:49:07,818 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:49:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:49:09,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:49:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:49:09,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:49:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:49:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:49:09,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:49:09,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) notificationworker stdout | 2022-11-28 07:49:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:22 UTC)" (scheduled at 2022-11-28 07:49:12.901291+00:00) notificationworker stdout | 2022-11-28 07:49:12,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:49:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:15 UTC)" (scheduled at 2022-11-28 07:49:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:49:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:49:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:45 UTC)" (scheduled at 2022-11-28 07:49:15.911636+00:00) securityworker stdout | 2022-11-28 07:49:15,989 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:49:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:47 UTC)" (scheduled at 2022-11-28 07:49:17.016425+00:00) gcworker stdout | 2022-11-28 07:49:17,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:49:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:32 UTC)" (scheduled at 2022-11-28 07:49:22.901291+00:00) notificationworker stdout | 2022-11-28 07:49:23,014 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:49:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:53 UTC)" (scheduled at 2022-11-28 07:49:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:49:23,185 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:49:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:49:24,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:49:24,501 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:49:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:49:24,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:49:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:49:24,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 07:49:24,593 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:49:24,609 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) notificationworker stdout | 2022-11-28 07:49:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:42 UTC)" (scheduled at 2022-11-28 07:49:32.901291+00:00) notificationworker stdout | 2022-11-28 07:49:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:49:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:33 UTC)" (scheduled at 2022-11-28 07:49:33.026570+00:00) notificationworker stdout | 2022-11-28 07:49:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:49:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:33 UTC)" (scheduled at 2022-11-28 07:49:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:49:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:49:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:07 UTC)" (scheduled at 2022-11-28 07:49:37.716126+00:00) securityworker stdout | 2022-11-28 07:49:37,754 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:49:37,839 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:49:37,839 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:49:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:54:38 UTC)" (scheduled at 2022-11-28 07:49:38.024004+00:00) notificationworker stdout | 2022-11-28 07:49:38,098 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:54:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:49:39,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) gunicorn-registry stdout | 2022-11-28 07:49:39,502 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:49:39,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:49:39,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:49:39,518 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:49:39,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 07:49:39,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:49:39,572 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) notificationworker stdout | 2022-11-28 07:49:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:52 UTC)" (scheduled at 2022-11-28 07:49:42.901291+00:00) notificationworker stdout | 2022-11-28 07:49:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:49:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:49:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:15 UTC)" (scheduled at 2022-11-28 07:49:45.911636+00:00) securityworker stdout | 2022-11-28 07:49:45,967 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:49:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:17 UTC)" (scheduled at 2022-11-28 07:49:47.016425+00:00) gcworker stdout | 2022-11-28 07:49:47,125 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:49:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:50 UTC)" (scheduled at 2022-11-28 07:49:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:49:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:49:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:51 UTC)" (scheduled at 2022-11-28 07:49:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:49:51,762 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:49:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:02 UTC)" (scheduled at 2022-11-28 07:49:52.901291+00:00) notificationworker stdout | 2022-11-28 07:49:52,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:49:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:23 UTC)" (scheduled at 2022-11-28 07:49:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:49:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:49:54,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:49:54,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:49:54,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:49:54,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:49:54,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.007) gunicorn-web stdout | 2022-11-28 07:49:54,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 07:49:54,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:49:54,568 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) securityscanningnotificationworker stdout | 2022-11-28 07:49:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:56 UTC)" (scheduled at 2022-11-28 07:49:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:49:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:49:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:57 UTC)" (scheduled at 2022-11-28 07:49:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:49:57,570 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:50:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:50:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:12 UTC)" (scheduled at 2022-11-28 07:50:02.901291+00:00) notificationworker stdout | 2022-11-28 07:50:02,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:50:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:03 UTC)" (scheduled at 2022-11-28 07:50:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:50:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:50:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:06 UTC)" (scheduled at 2022-11-28 07:50:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:50:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:06 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:50:06 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.573 635 0.573) gunicorn-registry stdout | 2022-11-28 07:50:06,435 [246] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:50:06 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:50:06 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.113 1652 0.113) gunicorn-registry stdout | 2022-11-28 07:50:06,585 [246] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:50:06 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:50:07,230 [246] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:50:07 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:50:07 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.055 1652 0.055) gunicorn-registry stdout | 2022-11-28 07:50:07,298 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:50:07,313 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:07:50:07 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:50:07 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.047 1631 0.047) securityworker stdout | 2022-11-28 07:50:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:37 UTC)" (scheduled at 2022-11-28 07:50:07.716126+00:00) securityworker stdout | 2022-11-28 07:50:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:50:07,801 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:50:07,802 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:50:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:50:09,492 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:09,494 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) gunicorn-registry stdout | 2022-11-28 07:50:09,499 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:50:09,514 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:09,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:50:09,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 07:50:09,615 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:50:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:22 UTC)" (scheduled at 2022-11-28 07:50:12.901291+00:00) notificationworker stdout | 2022-11-28 07:50:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:50:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:15 UTC)" (scheduled at 2022-11-28 07:50:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:50:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:50:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:45 UTC)" (scheduled at 2022-11-28 07:50:15.911636+00:00) securityworker stdout | 2022-11-28 07:50:15,944 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:50:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:47 UTC)" (scheduled at 2022-11-28 07:50:17.016425+00:00) gcworker stdout | 2022-11-28 07:50:17,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:50:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:32 UTC)" (scheduled at 2022-11-28 07:50:22.901291+00:00) notificationworker stdout | 2022-11-28 07:50:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:50:23,122 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:53 UTC)" (scheduled at 2022-11-28 07:50:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:50:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:50:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:50:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-web stdout | 2022-11-28 07:50:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:50:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:50:24,504 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 07:50:24,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:24,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:50:24,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:50:24,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) notificationworker stdout | 2022-11-28 07:50:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:42 UTC)" (scheduled at 2022-11-28 07:50:32.901291+00:00) notificationworker stdout | 2022-11-28 07:50:32,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:50:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:33 UTC)" (scheduled at 2022-11-28 07:50:33.026570+00:00) notificationworker stdout | 2022-11-28 07:50:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:50:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:33 UTC)" (scheduled at 2022-11-28 07:50:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:50:33,344 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:50:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:07 UTC)" (scheduled at 2022-11-28 07:50:37.716126+00:00) securityworker stdout | 2022-11-28 07:50:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:50:37,759 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:50:37,760 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:50:39,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:50:39,495 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:50:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:39,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:50:39,513 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:39,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:50:39,557 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:50:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) securityscanningnotificationworker stdout | 2022-11-28 07:50:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:55:41 UTC)" (scheduled at 2022-11-28 07:50:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:50:41,205 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:55:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:50:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:52 UTC)" (scheduled at 2022-11-28 07:50:42.901291+00:00) notificationworker stdout | 2022-11-28 07:50:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:50:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:50:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:15 UTC)" (scheduled at 2022-11-28 07:50:45.911636+00:00) securityworker stdout | 2022-11-28 07:50:45,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:50:47,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:17 UTC)" (scheduled at 2022-11-28 07:50:47.016425+00:00) gcworker stdout | 2022-11-28 07:50:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:50:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:55:48 UTC)" (scheduled at 2022-11-28 07:50:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:50:48,079 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:55:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:50:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:50 UTC)" (scheduled at 2022-11-28 07:50:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:50:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:50:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:51 UTC)" (scheduled at 2022-11-28 07:50:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:50:51,765 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:50:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:02 UTC)" (scheduled at 2022-11-28 07:50:52.901291+00:00) notificationworker stdout | 2022-11-28 07:50:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:50:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:23 UTC)" (scheduled at 2022-11-28 07:50:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:50:53,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:50:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:50:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:50:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 07:50:54,515 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:50:54,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:50:54,545 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 07:50:54,571 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) securityscanningnotificationworker stdout | 2022-11-28 07:50:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:56 UTC)" (scheduled at 2022-11-28 07:50:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:50:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:50:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:57 UTC)" (scheduled at 2022-11-28 07:50:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:50:57,567 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:51:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:51:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:12 UTC)" (scheduled at 2022-11-28 07:51:02.901291+00:00) notificationworker stdout | 2022-11-28 07:51:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:51:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:03 UTC)" (scheduled at 2022-11-28 07:51:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:51:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:51:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:06 UTC)" (scheduled at 2022-11-28 07:51:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:51:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:51:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:37 UTC)" (scheduled at 2022-11-28 07:51:07.716126+00:00) securityworker stdout | 2022-11-28 07:51:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:51:07,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:51:07,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:51:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:51:09,497 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:51:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:51:09,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:51:09,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:51:09,539 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:51:09,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 07:51:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:22 UTC)" (scheduled at 2022-11-28 07:51:12.901291+00:00) notificationworker stdout | 2022-11-28 07:51:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:51:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:15 UTC)" (scheduled at 2022-11-28 07:51:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:51:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:51:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:45 UTC)" (scheduled at 2022-11-28 07:51:15.911636+00:00) securityworker stdout | 2022-11-28 07:51:15,999 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:51:17,023 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:47 UTC)" (scheduled at 2022-11-28 07:51:17.016425+00:00) gcworker stdout | 2022-11-28 07:51:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:51:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:32 UTC)" (scheduled at 2022-11-28 07:51:22.901291+00:00) notificationworker stdout | 2022-11-28 07:51:22,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:51:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:53 UTC)" (scheduled at 2022-11-28 07:51:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:51:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:51:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 07:51:24,499 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:51:24,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:51:24,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:24,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:24,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:51:24,523 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:51:24,578 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) gunicorn-web stdout | 2022-11-28 07:51:24,600 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) notificationworker stdout | 2022-11-28 07:51:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:42 UTC)" (scheduled at 2022-11-28 07:51:32.901291+00:00) notificationworker stdout | 2022-11-28 07:51:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:51:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:33 UTC)" (scheduled at 2022-11-28 07:51:33.026570+00:00) notificationworker stdout | 2022-11-28 07:51:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:51:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:33 UTC)" (scheduled at 2022-11-28 07:51:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:51:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:51:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:07 UTC)" (scheduled at 2022-11-28 07:51:37.716126+00:00) securityworker stdout | 2022-11-28 07:51:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:51:37,775 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:51:37,778 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:51:39,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:51:39,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:51:39,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:39,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 07:51:39,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:39,518 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:51:39,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 07:51:39,571 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:51:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:52 UTC)" (scheduled at 2022-11-28 07:51:42.901291+00:00) notificationworker stdout | 2022-11-28 07:51:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:51:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:51:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:15 UTC)" (scheduled at 2022-11-28 07:51:45.911636+00:00) securityworker stdout | 2022-11-28 07:51:45,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:51:47,022 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:17 UTC)" (scheduled at 2022-11-28 07:51:47.016425+00:00) gcworker stdout | 2022-11-28 07:51:47,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:51:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:50 UTC)" (scheduled at 2022-11-28 07:51:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:51:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:51:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:51 UTC)" (scheduled at 2022-11-28 07:51:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:51:51,764 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:51:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:02 UTC)" (scheduled at 2022-11-28 07:51:52.901291+00:00) notificationworker stdout | 2022-11-28 07:51:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:51:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:23 UTC)" (scheduled at 2022-11-28 07:51:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:51:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:51:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 07:51:54,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 07:51:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:51:54,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:51:54,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:51:54,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:51:54,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 07:51:54,597 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:51:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:56 UTC)" (scheduled at 2022-11-28 07:51:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:51:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:51:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:57 UTC)" (scheduled at 2022-11-28 07:51:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:51:57,551 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:52:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:52:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:12 UTC)" (scheduled at 2022-11-28 07:52:02.901291+00:00) notificationworker stdout | 2022-11-28 07:52:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:52:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:03 UTC)" (scheduled at 2022-11-28 07:52:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:52:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:52:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:06 UTC)" (scheduled at 2022-11-28 07:52:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:52:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:52:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:37 UTC)" (scheduled at 2022-11-28 07:52:07.716126+00:00) securityworker stdout | 2022-11-28 07:52:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:52:07,767 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:52:07,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:52:09,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:52:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:52:09,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:52:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:52:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:52:09,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 07:52:09,544 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:52:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:22 UTC)" (scheduled at 2022-11-28 07:52:12.901291+00:00) notificationworker stdout | 2022-11-28 07:52:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:52:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:15 UTC)" (scheduled at 2022-11-28 07:52:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:52:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:52:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:45 UTC)" (scheduled at 2022-11-28 07:52:15.911636+00:00) securityworker stdout | 2022-11-28 07:52:15,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:52:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:47 UTC)" (scheduled at 2022-11-28 07:52:17.016425+00:00) gcworker stdout | 2022-11-28 07:52:17,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:52:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:32 UTC)" (scheduled at 2022-11-28 07:52:22.901291+00:00) notificationworker stdout | 2022-11-28 07:52:22,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:52:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:53 UTC)" (scheduled at 2022-11-28 07:52:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:52:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:52:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:52:24,497 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:52:24,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:52:24,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:24,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:52:24,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:52:24,556 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.097) gunicorn-web stdout | 2022-11-28 07:52:24,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:52:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:42 UTC)" (scheduled at 2022-11-28 07:52:32.901291+00:00) notificationworker stdout | 2022-11-28 07:52:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:52:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:33 UTC)" (scheduled at 2022-11-28 07:52:33.026570+00:00) notificationworker stdout | 2022-11-28 07:52:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:52:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:33 UTC)" (scheduled at 2022-11-28 07:52:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:52:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:52:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:07 UTC)" (scheduled at 2022-11-28 07:52:37.716126+00:00) securityworker stdout | 2022-11-28 07:52:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:52:37,756 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:52:37,757 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:52:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:52:39,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:52:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:52:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:39,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:52:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:52:39,547 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 07:52:39,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 07:52:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:52 UTC)" (scheduled at 2022-11-28 07:52:42.901291+00:00) notificationworker stdout | 2022-11-28 07:52:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:52:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:52:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:15 UTC)" (scheduled at 2022-11-28 07:52:45.911636+00:00) securityworker stdout | 2022-11-28 07:52:45,979 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:52:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:17 UTC)" (scheduled at 2022-11-28 07:52:47.016425+00:00) gcworker stdout | 2022-11-28 07:52:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:52:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:50 UTC)" (scheduled at 2022-11-28 07:52:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:52:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:52:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:51 UTC)" (scheduled at 2022-11-28 07:52:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:52:51,775 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:52:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:02 UTC)" (scheduled at 2022-11-28 07:52:52.901291+00:00) notificationworker stdout | 2022-11-28 07:52:52,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:52:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:23 UTC)" (scheduled at 2022-11-28 07:52:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:52:53,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.007) gunicorn-registry stdout | 2022-11-28 07:52:54,495 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.007) gunicorn-registry stdout | 2022-11-28 07:52:54,503 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:52:54,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:52:54,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:52:54,521 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:52:54,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 07:52:54,581 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:52:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:56 UTC)" (scheduled at 2022-11-28 07:52:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:52:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:52:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:57 UTC)" (scheduled at 2022-11-28 07:52:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:52:57,583 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:53:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:53:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:12 UTC)" (scheduled at 2022-11-28 07:53:02.901291+00:00) notificationworker stdout | 2022-11-28 07:53:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:53:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:03 UTC)" (scheduled at 2022-11-28 07:53:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:53:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:53:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:06 UTC)" (scheduled at 2022-11-28 07:53:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:53:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:53:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:37 UTC)" (scheduled at 2022-11-28 07:53:07.716126+00:00) securityworker stdout | 2022-11-28 07:53:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:53:07,769 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:53:07,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) gunicorn-registry stdout | 2022-11-28 07:53:09,503 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.022 162 0.022) gunicorn-registry stdout | 2022-11-28 07:53:09,506 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:53:09,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:09,519 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:53:09,527 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:53:09,529 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 07:53:09,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:53:09,570 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:53:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:22 UTC)" (scheduled at 2022-11-28 07:53:12.901291+00:00) notificationworker stdout | 2022-11-28 07:53:12,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:53:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:15 UTC)" (scheduled at 2022-11-28 07:53:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:53:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:53:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:45 UTC)" (scheduled at 2022-11-28 07:53:15.911636+00:00) securityworker stdout | 2022-11-28 07:53:15,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:53:17,021 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:47 UTC)" (scheduled at 2022-11-28 07:53:17.016425+00:00) gcworker stdout | 2022-11-28 07:53:17,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:53:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:32 UTC)" (scheduled at 2022-11-28 07:53:22.901291+00:00) notificationworker stdout | 2022-11-28 07:53:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:53:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:53 UTC)" (scheduled at 2022-11-28 07:53:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:53:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:53:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:53:24,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:53:24,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:53:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:24,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:53:24,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:53:24,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:53:24,557 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:53:24,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) notificationworker stdout | 2022-11-28 07:53:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:42 UTC)" (scheduled at 2022-11-28 07:53:32.901291+00:00) notificationworker stdout | 2022-11-28 07:53:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:53:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:33 UTC)" (scheduled at 2022-11-28 07:53:33.026570+00:00) notificationworker stdout | 2022-11-28 07:53:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:53:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:33 UTC)" (scheduled at 2022-11-28 07:53:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:53:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:53:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:07 UTC)" (scheduled at 2022-11-28 07:53:37.716126+00:00) securityworker stdout | 2022-11-28 07:53:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:53:37,754 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:53:37,754 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:53:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:58:38 UTC)" (scheduled at 2022-11-28 07:53:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:53:38,466 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:58:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:53:39,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:53:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:53:39,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:39,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:53:39,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 07:53:39,536 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.067) gunicorn-web stdout | 2022-11-28 07:53:39,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:53:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:52 UTC)" (scheduled at 2022-11-28 07:53:42.901291+00:00) notificationworker stdout | 2022-11-28 07:53:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:53:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:53:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:15 UTC)" (scheduled at 2022-11-28 07:53:45.911636+00:00) securityworker stdout | 2022-11-28 07:53:45,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:53:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:17 UTC)" (scheduled at 2022-11-28 07:53:47.016425+00:00) gcworker stdout | 2022-11-28 07:53:47,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:53:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:58:49 UTC)" (scheduled at 2022-11-28 07:53:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:53:49,440 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:58:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:53:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:50 UTC)" (scheduled at 2022-11-28 07:53:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:53:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:53:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:51 UTC)" (scheduled at 2022-11-28 07:53:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:53:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:53:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:02 UTC)" (scheduled at 2022-11-28 07:53:52.901291+00:00) notificationworker stdout | 2022-11-28 07:53:52,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:53:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:23 UTC)" (scheduled at 2022-11-28 07:53:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:53:53,137 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:53:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:53:54,500 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:53:54,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:54,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:53:54,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:53:54,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:53:54,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:53:54,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.078) securityscanningnotificationworker stdout | 2022-11-28 07:53:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:56 UTC)" (scheduled at 2022-11-28 07:53:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:53:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:53:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:57 UTC)" (scheduled at 2022-11-28 07:53:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:53:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:54:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:54:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:12 UTC)" (scheduled at 2022-11-28 07:54:02.901291+00:00) notificationworker stdout | 2022-11-28 07:54:02,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:54:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:03 UTC)" (scheduled at 2022-11-28 07:54:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:54:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:54:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:06 UTC)" (scheduled at 2022-11-28 07:54:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:54:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:54:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:37 UTC)" (scheduled at 2022-11-28 07:54:07.716126+00:00) securityworker stdout | 2022-11-28 07:54:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:54:07,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:54:07,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:54:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:54:09,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:09,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:54:09,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:54:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:54:09,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:54:09,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 07:54:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:22 UTC)" (scheduled at 2022-11-28 07:54:12.901291+00:00) notificationworker stdout | 2022-11-28 07:54:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:54:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:15 UTC)" (scheduled at 2022-11-28 07:54:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:54:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:54:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:45 UTC)" (scheduled at 2022-11-28 07:54:15.911636+00:00) securityworker stdout | 2022-11-28 07:54:15,955 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:54:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:47 UTC)" (scheduled at 2022-11-28 07:54:17.016425+00:00) gcworker stdout | 2022-11-28 07:54:17,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:54:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:32 UTC)" (scheduled at 2022-11-28 07:54:22.901291+00:00) notificationworker stdout | 2022-11-28 07:54:22,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:54:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:53 UTC)" (scheduled at 2022-11-28 07:54:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:54:23,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:54:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:54:24,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:54:24,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:24,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:24,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:54:24,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:54:24,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:54:24,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:54:24,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:54:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:42 UTC)" (scheduled at 2022-11-28 07:54:32.901291+00:00) notificationworker stdout | 2022-11-28 07:54:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:54:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:33 UTC)" (scheduled at 2022-11-28 07:54:33.026570+00:00) notificationworker stdout | 2022-11-28 07:54:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:54:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:33 UTC)" (scheduled at 2022-11-28 07:54:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:54:33,347 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:54:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:07 UTC)" (scheduled at 2022-11-28 07:54:37.716126+00:00) securityworker stdout | 2022-11-28 07:54:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:54:37,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:54:37,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:54:38,026 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:59:38 UTC)" (scheduled at 2022-11-28 07:54:38.024004+00:00) notificationworker stdout | 2022-11-28 07:54:38,076 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 07:59:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:54:39,502 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:54:39,502 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:54:39,519 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:54:39,520 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:39,522 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:54:39,523 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 07:54:39,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 07:54:39,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:54:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:52 UTC)" (scheduled at 2022-11-28 07:54:42.901291+00:00) notificationworker stdout | 2022-11-28 07:54:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:54:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:54:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:15 UTC)" (scheduled at 2022-11-28 07:54:45.911636+00:00) securityworker stdout | 2022-11-28 07:54:45,983 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:54:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:17 UTC)" (scheduled at 2022-11-28 07:54:47.016425+00:00) gcworker stdout | 2022-11-28 07:54:47,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:54:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:50 UTC)" (scheduled at 2022-11-28 07:54:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:54:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:54:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:51 UTC)" (scheduled at 2022-11-28 07:54:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:54:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:54:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:02 UTC)" (scheduled at 2022-11-28 07:54:52.901291+00:00) notificationworker stdout | 2022-11-28 07:54:52,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:54:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:23 UTC)" (scheduled at 2022-11-28 07:54:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:54:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:54:54,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:54:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:54:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:54,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:54:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:54:54,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 07:54:54,550 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 07:54:54,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:54:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:56 UTC)" (scheduled at 2022-11-28 07:54:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:54:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:54:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:57 UTC)" (scheduled at 2022-11-28 07:54:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:54:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:55:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:55:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:12 UTC)" (scheduled at 2022-11-28 07:55:02.901291+00:00) notificationworker stdout | 2022-11-28 07:55:02,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:55:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:03 UTC)" (scheduled at 2022-11-28 07:55:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:55:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:55:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:06 UTC)" (scheduled at 2022-11-28 07:55:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:55:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:55:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:37 UTC)" (scheduled at 2022-11-28 07:55:07.716126+00:00) securityworker stdout | 2022-11-28 07:55:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:55:07,775 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:55:07,776 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:55:09,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:55:09,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:55:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:55:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 07:55:09,538 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:55:09,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 07:55:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:22 UTC)" (scheduled at 2022-11-28 07:55:12.901291+00:00) notificationworker stdout | 2022-11-28 07:55:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:55:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:15 UTC)" (scheduled at 2022-11-28 07:55:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:55:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:55:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:45 UTC)" (scheduled at 2022-11-28 07:55:15.911636+00:00) securityworker stdout | 2022-11-28 07:55:15,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:55:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:47 UTC)" (scheduled at 2022-11-28 07:55:17.016425+00:00) gcworker stdout | 2022-11-28 07:55:17,089 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:55:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:32 UTC)" (scheduled at 2022-11-28 07:55:22.901291+00:00) notificationworker stdout | 2022-11-28 07:55:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:55:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:53 UTC)" (scheduled at 2022-11-28 07:55:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:55:23,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:55:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:55:24,509 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.025 162 0.025) gunicorn-registry stdout | 2022-11-28 07:55:24,524 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:24,528 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:55:24,529 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 07:55:24,551 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:24,557 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:55:24,602 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) gunicorn-web stdout | 2022-11-28 07:55:24,617 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) notificationworker stdout | 2022-11-28 07:55:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:42 UTC)" (scheduled at 2022-11-28 07:55:32.901291+00:00) notificationworker stdout | 2022-11-28 07:55:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:55:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:33 UTC)" (scheduled at 2022-11-28 07:55:33.026570+00:00) notificationworker stdout | 2022-11-28 07:55:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:55:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:33 UTC)" (scheduled at 2022-11-28 07:55:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:55:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:55:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:07 UTC)" (scheduled at 2022-11-28 07:55:37.716126+00:00) securityworker stdout | 2022-11-28 07:55:37,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:55:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:55:37,771 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:55:39,498 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:55:39,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 07:55:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:39,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 07:55:39,535 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:39,542 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:55:39,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:55:39,590 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) securityscanningnotificationworker stdout | 2022-11-28 07:55:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:00:41 UTC)" (scheduled at 2022-11-28 07:55:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:55:41,215 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:00:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:55:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:52 UTC)" (scheduled at 2022-11-28 07:55:42.901291+00:00) notificationworker stdout | 2022-11-28 07:55:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:55:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:55:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:15 UTC)" (scheduled at 2022-11-28 07:55:45.911636+00:00) securityworker stdout | 2022-11-28 07:55:45,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:55:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:17 UTC)" (scheduled at 2022-11-28 07:55:47.016425+00:00) gcworker stdout | 2022-11-28 07:55:47,044 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:17 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:55:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.487 635 0.487) gunicorn-registry stdout | 2022-11-28 07:55:47,426 [240] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:55:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:55:47 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.042 1652 0.042) gunicorn-registry stdout | 2022-11-28 07:55:47,548 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:55:47 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" exportactionlogsworker stdout | 2022-11-28 07:55:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:00:48 UTC)" (scheduled at 2022-11-28 07:55:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 07:55:48,079 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:00:48 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:55:48 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.035 1652 0.035) gunicorn-registry stdout | 2022-11-28 07:55:48,412 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:55:48 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" exportactionlogsworker stdout | 2022-11-28 07:55:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:50 UTC)" (scheduled at 2022-11-28 07:55:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:55:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:55:51,739 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:51 UTC)" (scheduled at 2022-11-28 07:55:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:55:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:55:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:02 UTC)" (scheduled at 2022-11-28 07:55:52.901291+00:00) notificationworker stdout | 2022-11-28 07:55:52,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:55:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:23 UTC)" (scheduled at 2022-11-28 07:55:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:55:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:55:54,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:55:54,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 07:55:54,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:55:54,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:55:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:55:54,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 07:55:54,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 07:55:54,551 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:55:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:56 UTC)" (scheduled at 2022-11-28 07:55:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:55:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:55:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:57 UTC)" (scheduled at 2022-11-28 07:55:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:55:57,614 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:56:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:56:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:12 UTC)" (scheduled at 2022-11-28 07:56:02.901291+00:00) notificationworker stdout | 2022-11-28 07:56:02,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:56:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:03 UTC)" (scheduled at 2022-11-28 07:56:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:56:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:56:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:06 UTC)" (scheduled at 2022-11-28 07:56:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:56:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:56:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:37 UTC)" (scheduled at 2022-11-28 07:56:07.716126+00:00) securityworker stdout | 2022-11-28 07:56:07,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:56:07,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:56:07,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:56:09,485 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:56:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:56:09,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:09,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:56:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 07:56:09,536 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:56:09,536 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) notificationworker stdout | 2022-11-28 07:56:12,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:22 UTC)" (scheduled at 2022-11-28 07:56:12.901291+00:00) notificationworker stdout | 2022-11-28 07:56:12,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:56:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:15 UTC)" (scheduled at 2022-11-28 07:56:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:56:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:56:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:45 UTC)" (scheduled at 2022-11-28 07:56:15.911636+00:00) securityworker stdout | 2022-11-28 07:56:15,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:56:17,042 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:47 UTC)" (scheduled at 2022-11-28 07:56:17.016425+00:00) gcworker stdout | 2022-11-28 07:56:17,100 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:56:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:32 UTC)" (scheduled at 2022-11-28 07:56:22.901291+00:00) notificationworker stdout | 2022-11-28 07:56:22,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:56:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:53 UTC)" (scheduled at 2022-11-28 07:56:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:56:23,180 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:56:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:56:24,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.014) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.023 162 0.023) gunicorn-registry stdout | 2022-11-28 07:56:24,506 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:56:24,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:24,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:56:24,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:56:24,515 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:56:24,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.088) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 07:56:24,566 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:56:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:42 UTC)" (scheduled at 2022-11-28 07:56:32.901291+00:00) notificationworker stdout | 2022-11-28 07:56:32,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:56:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:33 UTC)" (scheduled at 2022-11-28 07:56:33.026570+00:00) notificationworker stdout | 2022-11-28 07:56:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:56:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:33 UTC)" (scheduled at 2022-11-28 07:56:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:56:33,364 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:56:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:07 UTC)" (scheduled at 2022-11-28 07:56:37.716126+00:00) securityworker stdout | 2022-11-28 07:56:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:56:37,771 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:56:37,771 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:56:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:56:39,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 07:56:39,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:39,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 07:56:39,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:56:39,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:56:39,567 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:56:39,567 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 07:56:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:52 UTC)" (scheduled at 2022-11-28 07:56:42.901291+00:00) notificationworker stdout | 2022-11-28 07:56:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:56:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:56:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:15 UTC)" (scheduled at 2022-11-28 07:56:45.911636+00:00) securityworker stdout | 2022-11-28 07:56:45,948 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:56:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:17 UTC)" (scheduled at 2022-11-28 07:56:47.016425+00:00) gcworker stdout | 2022-11-28 07:56:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:56:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:50 UTC)" (scheduled at 2022-11-28 07:56:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:56:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:56:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:51 UTC)" (scheduled at 2022-11-28 07:56:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:56:51,775 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:56:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:02 UTC)" (scheduled at 2022-11-28 07:56:52.901291+00:00) notificationworker stdout | 2022-11-28 07:56:52,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:56:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:23 UTC)" (scheduled at 2022-11-28 07:56:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:56:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:56:54,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:56:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:54,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:56:54,503 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:56:54,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:56:54,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:56:54,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) gunicorn-web stdout | 2022-11-28 07:56:54,608 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:56:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:56 UTC)" (scheduled at 2022-11-28 07:56:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:56:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:56:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:57 UTC)" (scheduled at 2022-11-28 07:56:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:56:57,619 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:57:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:57:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:12 UTC)" (scheduled at 2022-11-28 07:57:02.901291+00:00) notificationworker stdout | 2022-11-28 07:57:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:57:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:03 UTC)" (scheduled at 2022-11-28 07:57:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:57:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:57:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:06 UTC)" (scheduled at 2022-11-28 07:57:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:57:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:57:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:37 UTC)" (scheduled at 2022-11-28 07:57:07.716126+00:00) securityworker stdout | 2022-11-28 07:57:07,759 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:57:07,816 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:57:07,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 07:57:09,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:57:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:57:09,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:09,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:57:09,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:09,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) gunicorn-web stdout | 2022-11-28 07:57:09,532 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 07:57:09,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:57:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:22 UTC)" (scheduled at 2022-11-28 07:57:12.901291+00:00) notificationworker stdout | 2022-11-28 07:57:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:22 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:07:57:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.707 635 0.707) gunicorn-registry stdout | 2022-11-28 07:57:14,834 [247] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:07:57:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:57:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.175 1652 0.175) gunicorn-registry stdout | 2022-11-28 07:57:15,024 [241] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:57:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" exportactionlogsworker stdout | 2022-11-28 07:57:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:15 UTC)" (scheduled at 2022-11-28 07:57:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:57:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:15 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:57:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.061 1652 0.061) gunicorn-registry stdout | 2022-11-28 07:57:15,105 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:07:57:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:e9c624028e47b215e2623bd72e29409de44551dee66e9578d95bb98da4c97953 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 07:57:15,408 [242] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 07:57:15,423 [242] [INFO] [gunicorn.access] - - [28/Nov/2022:07:57:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:07:57:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.296 1631 0.296) securityworker stdout | 2022-11-28 07:57:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:45 UTC)" (scheduled at 2022-11-28 07:57:15.911636+00:00) securityworker stdout | 2022-11-28 07:57:15,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:57:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:47 UTC)" (scheduled at 2022-11-28 07:57:17.016425+00:00) gcworker stdout | 2022-11-28 07:57:17,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:57:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:32 UTC)" (scheduled at 2022-11-28 07:57:22.901291+00:00) notificationworker stdout | 2022-11-28 07:57:22,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:57:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:53 UTC)" (scheduled at 2022-11-28 07:57:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:57:23,202 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:57:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.005) gunicorn-registry stdout | 2022-11-28 07:57:24,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:57:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:24,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:57:24,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:24,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 07:57:24,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:24,603 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.132 118 0.132) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.143 118 0.143) gunicorn-web stdout | 2022-11-28 07:57:24,615 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:57:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:42 UTC)" (scheduled at 2022-11-28 07:57:32.901291+00:00) notificationworker stdout | 2022-11-28 07:57:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:57:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:33 UTC)" (scheduled at 2022-11-28 07:57:33.026570+00:00) notificationworker stdout | 2022-11-28 07:57:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:57:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:33 UTC)" (scheduled at 2022-11-28 07:57:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:57:33,344 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:57:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:07 UTC)" (scheduled at 2022-11-28 07:57:37.716126+00:00) securityworker stdout | 2022-11-28 07:57:37,736 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:57:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:57:37,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 07:57:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:57:39,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) gunicorn-web stdout | 2022-11-28 07:57:39,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 07:57:39,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:57:39,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 07:57:39,561 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:57:39,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 07:57:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:52 UTC)" (scheduled at 2022-11-28 07:57:42.901291+00:00) notificationworker stdout | 2022-11-28 07:57:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:57:52 UTC)" executed successfully servicekey stdout | 2022-11-28 07:57:44,409 [95] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 08:52:44 UTC)" (scheduled at 2022-11-28 07:57:44.408575+00:00) servicekey stdout | 2022-11-28 07:57:44,441 [95] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 08:52:44 UTC)" executed successfully securityworker stdout | 2022-11-28 07:57:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:15 UTC)" (scheduled at 2022-11-28 07:57:45.911636+00:00) securityworker stdout | 2022-11-28 07:57:45,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:57:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:17 UTC)" (scheduled at 2022-11-28 07:57:47.016425+00:00) gcworker stdout | 2022-11-28 07:57:47,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:57:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:50 UTC)" (scheduled at 2022-11-28 07:57:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:57:50,172 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:57:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:51 UTC)" (scheduled at 2022-11-28 07:57:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:57:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:57:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:02 UTC)" (scheduled at 2022-11-28 07:57:52.901291+00:00) notificationworker stdout | 2022-11-28 07:57:52,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:57:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:23 UTC)" (scheduled at 2022-11-28 07:57:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:57:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 07:57:54,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:57:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:54,491 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 07:57:54,494 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:57:54,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:57:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:57:54,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 07:57:54,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 07:57:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:56 UTC)" (scheduled at 2022-11-28 07:57:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:57:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:57:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:57 UTC)" (scheduled at 2022-11-28 07:57:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:57:57,555 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:58:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:58:02,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:12 UTC)" (scheduled at 2022-11-28 07:58:02.901291+00:00) notificationworker stdout | 2022-11-28 07:58:02,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:58:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:03 UTC)" (scheduled at 2022-11-28 07:58:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:58:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:58:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:06 UTC)" (scheduled at 2022-11-28 07:58:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:58:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:58:07,722 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:37 UTC)" (scheduled at 2022-11-28 07:58:07.716126+00:00) securityworker stdout | 2022-11-28 07:58:07,749 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:58:07,825 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:58:07,826 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:58:09,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:58:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:58:09,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:58:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:58:09,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 07:58:09,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.079) gunicorn-web stdout | 2022-11-28 07:58:09,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 07:58:09,573 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:58:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:22 UTC)" (scheduled at 2022-11-28 07:58:12.901291+00:00) notificationworker stdout | 2022-11-28 07:58:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:58:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:15 UTC)" (scheduled at 2022-11-28 07:58:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:58:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:58:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:45 UTC)" (scheduled at 2022-11-28 07:58:15.911636+00:00) securityworker stdout | 2022-11-28 07:58:15,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:58:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:47 UTC)" (scheduled at 2022-11-28 07:58:17.016425+00:00) gcworker stdout | 2022-11-28 07:58:17,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:58:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:32 UTC)" (scheduled at 2022-11-28 07:58:22.901291+00:00) notificationworker stdout | 2022-11-28 07:58:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:58:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:53 UTC)" (scheduled at 2022-11-28 07:58:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:58:23,137 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:58:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 07:58:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:58:24,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:58:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:58:24,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 07:58:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:58:24,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:58:24,547 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 07:58:24,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:58:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:42 UTC)" (scheduled at 2022-11-28 07:58:32.901291+00:00) notificationworker stdout | 2022-11-28 07:58:32,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:58:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:33 UTC)" (scheduled at 2022-11-28 07:58:33.026570+00:00) notificationworker stdout | 2022-11-28 07:58:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:58:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:33 UTC)" (scheduled at 2022-11-28 07:58:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:58:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:58:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:07 UTC)" (scheduled at 2022-11-28 07:58:37.716126+00:00) securityworker stdout | 2022-11-28 07:58:37,748 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:58:37,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:58:37,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:58:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:03:38 UTC)" (scheduled at 2022-11-28 07:58:38.420756+00:00) namespacegcworker stdout | 2022-11-28 07:58:38,499 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:03:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 07:58:39,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 07:58:39,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:58:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:58:39,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:58:39,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:58:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.063) gunicorn-web stdout | 2022-11-28 07:58:39,535 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.069) gunicorn-web stdout | 2022-11-28 07:58:39,540 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 07:58:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:52 UTC)" (scheduled at 2022-11-28 07:58:42.901291+00:00) notificationworker stdout | 2022-11-28 07:58:42,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:58:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:58:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:15 UTC)" (scheduled at 2022-11-28 07:58:45.911636+00:00) securityworker stdout | 2022-11-28 07:58:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:58:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:17 UTC)" (scheduled at 2022-11-28 07:58:47.016425+00:00) gcworker stdout | 2022-11-28 07:58:47,044 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:58:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:03:49 UTC)" (scheduled at 2022-11-28 07:58:49.405459+00:00) repositorygcworker stdout | 2022-11-28 07:58:49,438 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:03:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:58:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:50 UTC)" (scheduled at 2022-11-28 07:58:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:58:50,171 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:58:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:51 UTC)" (scheduled at 2022-11-28 07:58:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:58:51,763 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:58:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:02 UTC)" (scheduled at 2022-11-28 07:58:52.901291+00:00) notificationworker stdout | 2022-11-28 07:58:52,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:58:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:23 UTC)" (scheduled at 2022-11-28 07:58:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:58:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.019 162 0.019) gunicorn-registry stdout | 2022-11-28 07:58:54,503 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:58:54,501 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:58:54,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:58:54,517 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:58:54,519 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:58:54,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:58:54,585 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) gunicorn-web stdout | 2022-11-28 07:58:54,634 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) securityscanningnotificationworker stdout | 2022-11-28 07:58:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:56 UTC)" (scheduled at 2022-11-28 07:58:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:58:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:58:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:57 UTC)" (scheduled at 2022-11-28 07:58:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:58:57,576 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 07:59:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:59:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:12 UTC)" (scheduled at 2022-11-28 07:59:02.901291+00:00) notificationworker stdout | 2022-11-28 07:59:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:59:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:03 UTC)" (scheduled at 2022-11-28 07:59:03.406131+00:00) repositorygcworker stdout | 2022-11-28 07:59:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:59:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:06 UTC)" (scheduled at 2022-11-28 07:59:06.421235+00:00) namespacegcworker stdout | 2022-11-28 07:59:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:06 UTC)" executed successfully securityworker stdout | 2022-11-28 07:59:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:37 UTC)" (scheduled at 2022-11-28 07:59:07.716126+00:00) securityworker stdout | 2022-11-28 07:59:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:59:07,793 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:59:07,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 07:59:09,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 07:59:09,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:59:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:59:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:59:09,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:59:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 07:59:09,544 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:59:09,544 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) notificationworker stdout | 2022-11-28 07:59:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:22 UTC)" (scheduled at 2022-11-28 07:59:12.901291+00:00) notificationworker stdout | 2022-11-28 07:59:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:59:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:15 UTC)" (scheduled at 2022-11-28 07:59:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 07:59:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:15 UTC)" executed successfully securityworker stdout | 2022-11-28 07:59:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:45 UTC)" (scheduled at 2022-11-28 07:59:15.911636+00:00) securityworker stdout | 2022-11-28 07:59:15,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:45 UTC)" executed successfully gcworker stdout | 2022-11-28 07:59:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:47 UTC)" (scheduled at 2022-11-28 07:59:17.016425+00:00) gcworker stdout | 2022-11-28 07:59:17,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:59:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:32 UTC)" (scheduled at 2022-11-28 07:59:22.901291+00:00) notificationworker stdout | 2022-11-28 07:59:22,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:59:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:53 UTC)" (scheduled at 2022-11-28 07:59:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:59:23,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 07:59:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 07:59:24,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 07:59:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:59:24,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:59:24,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 07:59:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:59:24,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:59:24,577 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 07:59:24,613 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) notificationworker stdout | 2022-11-28 07:59:32,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:42 UTC)" (scheduled at 2022-11-28 07:59:32.901291+00:00) notificationworker stdout | 2022-11-28 07:59:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:59:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:33 UTC)" (scheduled at 2022-11-28 07:59:33.026570+00:00) notificationworker stdout | 2022-11-28 07:59:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 07:59:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:33 UTC)" (scheduled at 2022-11-28 07:59:33.321475+00:00) repositorygcworker stdout | 2022-11-28 07:59:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:33 UTC)" executed successfully securityworker stdout | 2022-11-28 07:59:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:07 UTC)" (scheduled at 2022-11-28 07:59:37.716126+00:00) securityworker stdout | 2022-11-28 07:59:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 07:59:37,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 07:59:37,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:59:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:04:38 UTC)" (scheduled at 2022-11-28 07:59:38.024004+00:00) notificationworker stdout | 2022-11-28 07:59:38,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:04:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 07:59:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 07:59:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 07:59:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:59:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 07:59:39,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:59:39,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 07:59:39,536 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:59:39,536 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) notificationworker stdout | 2022-11-28 07:59:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:52 UTC)" (scheduled at 2022-11-28 07:59:42.901291+00:00) notificationworker stdout | 2022-11-28 07:59:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 07:59:52 UTC)" executed successfully securityworker stdout | 2022-11-28 07:59:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:15 UTC)" (scheduled at 2022-11-28 07:59:45.911636+00:00) securityworker stdout | 2022-11-28 07:59:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:15 UTC)" executed successfully gcworker stdout | 2022-11-28 07:59:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:17 UTC)" (scheduled at 2022-11-28 07:59:47.016425+00:00) gcworker stdout | 2022-11-28 07:59:47,055 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 07:59:50,132 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:50 UTC)" (scheduled at 2022-11-28 07:59:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 07:59:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 07:59:51,756 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:51 UTC)" (scheduled at 2022-11-28 07:59:51.733764+00:00) namespacegcworker stdout | 2022-11-28 07:59:51,796 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 07:59:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:02 UTC)" (scheduled at 2022-11-28 07:59:52.901291+00:00) notificationworker stdout | 2022-11-28 07:59:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 07:59:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:23 UTC)" (scheduled at 2022-11-28 07:59:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 07:59:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 07:59:54,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) gunicorn-registry stdout | 2022-11-28 07:59:54,499 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 07:59:54,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 07:59:54,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:59:54,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 07:59:54,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 07:59:54,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 07:59:54,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:07:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.098) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:07:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) securityscanningnotificationworker stdout | 2022-11-28 07:59:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:56 UTC)" (scheduled at 2022-11-28 07:59:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:59:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 07:59:57,534 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:57 UTC)" (scheduled at 2022-11-28 07:59:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 07:59:57,616 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:00:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:00:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:12 UTC)" (scheduled at 2022-11-28 08:00:02.901291+00:00) notificationworker stdout | 2022-11-28 08:00:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:00:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:03 UTC)" (scheduled at 2022-11-28 08:00:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:00:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:00:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:06 UTC)" (scheduled at 2022-11-28 08:00:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:00:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:00:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:37 UTC)" (scheduled at 2022-11-28 08:00:07.716126+00:00) securityworker stdout | 2022-11-28 08:00:07,737 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:00:07,777 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:00:07,778 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:00:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:00:09,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:00:09,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:09,495 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:00:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:00:09,530 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 08:00:09,537 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) notificationworker stdout | 2022-11-28 08:00:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:22 UTC)" (scheduled at 2022-11-28 08:00:12.901291+00:00) notificationworker stdout | 2022-11-28 08:00:12,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:00:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:15 UTC)" (scheduled at 2022-11-28 08:00:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:00:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:00:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:45 UTC)" (scheduled at 2022-11-28 08:00:15.911636+00:00) securityworker stdout | 2022-11-28 08:00:15,977 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:45 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:00:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.005 487 0.005) gunicorn-registry stdout | 2022-11-28 08:00:16,847 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:00:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" gcworker stdout | 2022-11-28 08:00:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:47 UTC)" (scheduled at 2022-11-28 08:00:17.016425+00:00) gcworker stdout | 2022-11-28 08:00:17,103 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:47 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:08:00:17 +0000] "GET /v2/auth?account=quayadmin&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 941 "-" "containers/5.21.1 (github.com/containers/image)" (0.456 582 0.456) gunicorn-registry stdout | 2022-11-28 08:00:17,358 [243] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:08:00:17 +0000] "GET /v2/auth?account=quayadmin&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 941 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:00:17 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.012 1439 0.012) gunicorn-registry stdout | 2022-11-28 08:00:17,401 [247] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:00:17 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "containers/5.21.1 (github.com/containers/image)" notificationworker stdout | 2022-11-28 08:00:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:32 UTC)" (scheduled at 2022-11-28 08:00:22.901291+00:00) notificationworker stdout | 2022-11-28 08:00:22,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:00:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:53 UTC)" (scheduled at 2022-11-28 08:00:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:00:23,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:00:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:00:24,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:00:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:00:24,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:24,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:00:24,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:00:24,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 08:00:24,597 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 08:00:24,600 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:00:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:42 UTC)" (scheduled at 2022-11-28 08:00:32.901291+00:00) notificationworker stdout | 2022-11-28 08:00:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:00:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:33 UTC)" (scheduled at 2022-11-28 08:00:33.026570+00:00) notificationworker stdout | 2022-11-28 08:00:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:00:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:33 UTC)" (scheduled at 2022-11-28 08:00:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:00:33,379 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:00:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:07 UTC)" (scheduled at 2022-11-28 08:00:37.716126+00:00) securityworker stdout | 2022-11-28 08:00:37,870 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:00:38,026 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:00:38,027 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:00:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.010) gunicorn-registry stdout | 2022-11-28 08:00:39,497 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:00:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:00:39,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:39,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:00:39,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:00:39,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:00:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:05:41 UTC)" (scheduled at 2022-11-28 08:00:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:00:41,206 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:05:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:00:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:52 UTC)" (scheduled at 2022-11-28 08:00:42.901291+00:00) notificationworker stdout | 2022-11-28 08:00:42,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:00:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:00:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:15 UTC)" (scheduled at 2022-11-28 08:00:45.911636+00:00) securityworker stdout | 2022-11-28 08:00:45,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:00:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:17 UTC)" (scheduled at 2022-11-28 08:00:47.016425+00:00) gcworker stdout | 2022-11-28 08:00:47,054 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:00:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:05:48 UTC)" (scheduled at 2022-11-28 08:00:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:00:48,097 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:05:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:00:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:50 UTC)" (scheduled at 2022-11-28 08:00:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:00:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:00:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:51 UTC)" (scheduled at 2022-11-28 08:00:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:00:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:00:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:02 UTC)" (scheduled at 2022-11-28 08:00:52.901291+00:00) notificationworker stdout | 2022-11-28 08:00:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:00:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:23 UTC)" (scheduled at 2022-11-28 08:00:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:00:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:00:54,501 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:00:54,502 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:00:54,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:54,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:00:54,523 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:00:54,527 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:00:54,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:00:54,579 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:00:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:56 UTC)" (scheduled at 2022-11-28 08:00:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:00:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:00:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:57 UTC)" (scheduled at 2022-11-28 08:00:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:00:57,589 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:01:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:01:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:12 UTC)" (scheduled at 2022-11-28 08:01:02.901291+00:00) notificationworker stdout | 2022-11-28 08:01:02,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:01:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:03 UTC)" (scheduled at 2022-11-28 08:01:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:01:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:01:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:06 UTC)" (scheduled at 2022-11-28 08:01:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:01:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:01:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:37 UTC)" (scheduled at 2022-11-28 08:01:07.716126+00:00) securityworker stdout | 2022-11-28 08:01:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:01:07,753 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:01:07,754 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:01:09,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:01:09,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:01:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:09,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:01:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:09,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 08:01:09,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.074) notificationworker stdout | 2022-11-28 08:01:12,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:22 UTC)" (scheduled at 2022-11-28 08:01:12.901291+00:00) notificationworker stdout | 2022-11-28 08:01:12,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:01:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:15 UTC)" (scheduled at 2022-11-28 08:01:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:01:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:01:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:45 UTC)" (scheduled at 2022-11-28 08:01:15.911636+00:00) securityworker stdout | 2022-11-28 08:01:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:01:17,026 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:47 UTC)" (scheduled at 2022-11-28 08:01:17.016425+00:00) gcworker stdout | 2022-11-28 08:01:17,090 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:01:22,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:32 UTC)" (scheduled at 2022-11-28 08:01:22.901291+00:00) notificationworker stdout | 2022-11-28 08:01:22,998 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:01:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:53 UTC)" (scheduled at 2022-11-28 08:01:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:01:23,182 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:01:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:01:24,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:01:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:24,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.002) gunicorn-web stdout | 2022-11-28 08:01:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:24,560 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.088) gunicorn-web stdout | 2022-11-28 08:01:24,564 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 08:01:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:42 UTC)" (scheduled at 2022-11-28 08:01:32.901291+00:00) notificationworker stdout | 2022-11-28 08:01:32,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:01:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:33 UTC)" (scheduled at 2022-11-28 08:01:33.026570+00:00) notificationworker stdout | 2022-11-28 08:01:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:01:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:33 UTC)" (scheduled at 2022-11-28 08:01:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:01:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:01:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:07 UTC)" (scheduled at 2022-11-28 08:01:37.716126+00:00) securityworker stdout | 2022-11-28 08:01:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:01:37,759 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:01:37,760 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:01:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:01:39,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:01:39,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:01:39,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:01:39,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:01:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:52 UTC)" (scheduled at 2022-11-28 08:01:42.901291+00:00) notificationworker stdout | 2022-11-28 08:01:42,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:01:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:01:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:15 UTC)" (scheduled at 2022-11-28 08:01:45.911636+00:00) securityworker stdout | 2022-11-28 08:01:45,950 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:01:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:17 UTC)" (scheduled at 2022-11-28 08:01:47.016425+00:00) gcworker stdout | 2022-11-28 08:01:47,047 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:01:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:50 UTC)" (scheduled at 2022-11-28 08:01:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:01:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:01:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:51 UTC)" (scheduled at 2022-11-28 08:01:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:01:51,763 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:01:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:02 UTC)" (scheduled at 2022-11-28 08:01:52.901291+00:00) notificationworker stdout | 2022-11-28 08:01:52,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:01:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:23 UTC)" (scheduled at 2022-11-28 08:01:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:01:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:01:54,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-web stdout | 2022-11-28 08:01:54,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:01:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:01:54,494 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:01:54,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:01:54,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 08:01:54,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:01:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:56 UTC)" (scheduled at 2022-11-28 08:01:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:01:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:01:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:57 UTC)" (scheduled at 2022-11-28 08:01:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:01:57,574 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:02:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:02:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:12 UTC)" (scheduled at 2022-11-28 08:02:02.901291+00:00) notificationworker stdout | 2022-11-28 08:02:02,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:02:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:03 UTC)" (scheduled at 2022-11-28 08:02:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:02:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:02:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:06 UTC)" (scheduled at 2022-11-28 08:02:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:02:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:02:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:37 UTC)" (scheduled at 2022-11-28 08:02:07.716126+00:00) securityworker stdout | 2022-11-28 08:02:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:02:07,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:02:07,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:02:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 08:02:09,498 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:09,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 08:02:09,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:09,513 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:02:09,520 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:02:09,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 08:02:09,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:02:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:22 UTC)" (scheduled at 2022-11-28 08:02:12.901291+00:00) notificationworker stdout | 2022-11-28 08:02:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:22 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:02:13,969 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:02:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:02:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "containers/5.21.1 (github.com/containers/image)" (0.010 487 0.010) nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:08:02:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.670 635 0.670) gunicorn-registry stdout | 2022-11-28 08:02:14,656 [240] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:08:02:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:08:02:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.833 635 0.833) gunicorn-registry stdout | 2022-11-28 08:02:14,817 [245] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:08:02:14 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:02:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.173 1652 0.173) gunicorn-registry stdout | 2022-11-28 08:02:14,867 [246] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:02:14 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:02:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:d3f9ef61fcbec90776e13dc4bf74362d077527d92f7294944b283f03cbacf418 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.166 1652 0.166) gunicorn-registry stdout | 2022-11-28 08:02:15,005 [242] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:02:15 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:d3f9ef61fcbec90776e13dc4bf74362d077527d92f7294944b283f03cbacf418 HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" exportactionlogsworker stdout | 2022-11-28 08:02:15,040 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:15 UTC)" (scheduled at 2022-11-28 08:02:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:02:15,041 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:15 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:02:15,026 [245] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 08:02:15,096 [245] [INFO] [gunicorn.access] - - [28/Nov/2022:08:02:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" gunicorn-registry stdout | 2022-11-28 08:02:15,096 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 08:02:15,099 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:08:02:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:02:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.157 1631 0.157) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:02:15 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.058 1631 0.058) securityworker stdout | 2022-11-28 08:02:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:45 UTC)" (scheduled at 2022-11-28 08:02:15.911636+00:00) securityworker stdout | 2022-11-28 08:02:15,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:02:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:47 UTC)" (scheduled at 2022-11-28 08:02:17.016425+00:00) gcworker stdout | 2022-11-28 08:02:17,044 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:02:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:32 UTC)" (scheduled at 2022-11-28 08:02:22.901291+00:00) notificationworker stdout | 2022-11-28 08:02:22,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:02:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:53 UTC)" (scheduled at 2022-11-28 08:02:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:02:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:02:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:02:24,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:02:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:02:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:24,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:02:24,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:24,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:24,630 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.159 118 0.159) gunicorn-web stdout | 2022-11-28 08:02:24,642 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.172 118 0.172) notificationworker stdout | 2022-11-28 08:02:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:42 UTC)" (scheduled at 2022-11-28 08:02:32.901291+00:00) notificationworker stdout | 2022-11-28 08:02:32,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:02:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:33 UTC)" (scheduled at 2022-11-28 08:02:33.026570+00:00) notificationworker stdout | 2022-11-28 08:02:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:02:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:33 UTC)" (scheduled at 2022-11-28 08:02:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:02:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:02:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:07 UTC)" (scheduled at 2022-11-28 08:02:37.716126+00:00) securityworker stdout | 2022-11-28 08:02:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:02:37,844 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:02:37,845 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:02:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:02:39,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:39,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:02:39,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:02:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:39,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:02:39,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) notificationworker stdout | 2022-11-28 08:02:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:52 UTC)" (scheduled at 2022-11-28 08:02:42.901291+00:00) notificationworker stdout | 2022-11-28 08:02:42,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:02:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:02:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:15 UTC)" (scheduled at 2022-11-28 08:02:45.911636+00:00) securityworker stdout | 2022-11-28 08:02:46,009 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:02:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:17 UTC)" (scheduled at 2022-11-28 08:02:47.016425+00:00) gcworker stdout | 2022-11-28 08:02:47,118 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:02:50,133 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:50 UTC)" (scheduled at 2022-11-28 08:02:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:02:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:02:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:51 UTC)" (scheduled at 2022-11-28 08:02:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:02:51,782 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:02:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:02 UTC)" (scheduled at 2022-11-28 08:02:52.901291+00:00) notificationworker stdout | 2022-11-28 08:02:52,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:02:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:23 UTC)" (scheduled at 2022-11-28 08:02:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:02:53,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:02:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:02:54,501 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:54,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:02:54,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:02:54,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:02:54,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 08:02:54,566 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) securityscanningnotificationworker stdout | 2022-11-28 08:02:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:56 UTC)" (scheduled at 2022-11-28 08:02:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:02:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:02:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:57 UTC)" (scheduled at 2022-11-28 08:02:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:02:57,600 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:03:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:03:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:12 UTC)" (scheduled at 2022-11-28 08:03:02.901291+00:00) notificationworker stdout | 2022-11-28 08:03:02,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:03:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:03 UTC)" (scheduled at 2022-11-28 08:03:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:03:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:03:06,427 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:06 UTC)" (scheduled at 2022-11-28 08:03:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:03:06,427 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:03:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:37 UTC)" (scheduled at 2022-11-28 08:03:07.716126+00:00) securityworker stdout | 2022-11-28 08:03:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:03:07,787 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:03:07,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:03:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:03:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:03:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:03:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:03:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:03:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:09,545 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.074) gunicorn-web stdout | 2022-11-28 08:03:09,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.083) notificationworker stdout | 2022-11-28 08:03:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:22 UTC)" (scheduled at 2022-11-28 08:03:12.901291+00:00) notificationworker stdout | 2022-11-28 08:03:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:03:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:15 UTC)" (scheduled at 2022-11-28 08:03:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:03:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:03:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:45 UTC)" (scheduled at 2022-11-28 08:03:15.911636+00:00) securityworker stdout | 2022-11-28 08:03:15,963 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:03:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:47 UTC)" (scheduled at 2022-11-28 08:03:17.016425+00:00) gcworker stdout | 2022-11-28 08:03:17,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:03:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:32 UTC)" (scheduled at 2022-11-28 08:03:22.901291+00:00) notificationworker stdout | 2022-11-28 08:03:22,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:03:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:53 UTC)" (scheduled at 2022-11-28 08:03:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:03:23,137 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:03:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:03:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:03:24,493 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:03:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:03:24,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:03:24,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:24,537 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 08:03:24,538 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:03:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:42 UTC)" (scheduled at 2022-11-28 08:03:32.901291+00:00) notificationworker stdout | 2022-11-28 08:03:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:03:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:33 UTC)" (scheduled at 2022-11-28 08:03:33.026570+00:00) notificationworker stdout | 2022-11-28 08:03:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:03:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:33 UTC)" (scheduled at 2022-11-28 08:03:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:03:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:03:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:07 UTC)" (scheduled at 2022-11-28 08:03:37.716126+00:00) securityworker stdout | 2022-11-28 08:03:37,786 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:03:37,946 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:03:37,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:03:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:08:38 UTC)" (scheduled at 2022-11-28 08:03:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:03:38,480 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:08:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) gunicorn-registry stdout | 2022-11-28 08:03:39,501 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 08:03:39,519 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:03:39,520 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:03:39,524 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:39,532 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:03:39,535 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:39,575 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 08:03:39,587 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) notificationworker stdout | 2022-11-28 08:03:42,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:52 UTC)" (scheduled at 2022-11-28 08:03:42.901291+00:00) notificationworker stdout | 2022-11-28 08:03:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:03:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:03:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:15 UTC)" (scheduled at 2022-11-28 08:03:45.911636+00:00) securityworker stdout | 2022-11-28 08:03:45,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:03:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:17 UTC)" (scheduled at 2022-11-28 08:03:47.016425+00:00) gcworker stdout | 2022-11-28 08:03:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:03:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:08:49 UTC)" (scheduled at 2022-11-28 08:03:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:03:49,444 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:08:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:03:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:50 UTC)" (scheduled at 2022-11-28 08:03:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:03:50,155 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:03:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:51 UTC)" (scheduled at 2022-11-28 08:03:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:03:51,769 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:03:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:02 UTC)" (scheduled at 2022-11-28 08:03:52.901291+00:00) notificationworker stdout | 2022-11-28 08:03:52,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:03:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:23 UTC)" (scheduled at 2022-11-28 08:03:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:03:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:03:54,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:03:54,505 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:03:54,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.021 162 0.020) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:03:54,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:54,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:03:54,521 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:03:54,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:03:54,574 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) securityscanningnotificationworker stdout | 2022-11-28 08:03:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:56 UTC)" (scheduled at 2022-11-28 08:03:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:03:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:03:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:57 UTC)" (scheduled at 2022-11-28 08:03:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:03:57,550 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:04:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:04:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:12 UTC)" (scheduled at 2022-11-28 08:04:02.901291+00:00) notificationworker stdout | 2022-11-28 08:04:02,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:04:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:03 UTC)" (scheduled at 2022-11-28 08:04:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:04:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:04:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:06 UTC)" (scheduled at 2022-11-28 08:04:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:04:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:04:07,721 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:37 UTC)" (scheduled at 2022-11-28 08:04:07.716126+00:00) securityworker stdout | 2022-11-28 08:04:07,745 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:04:07,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:04:07,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:04:09,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:04:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:04:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:04:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:09,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:04:09,543 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:04:09,544 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 08:04:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:22 UTC)" (scheduled at 2022-11-28 08:04:12.901291+00:00) notificationworker stdout | 2022-11-28 08:04:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:04:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:15 UTC)" (scheduled at 2022-11-28 08:04:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:04:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:04:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:45 UTC)" (scheduled at 2022-11-28 08:04:15.911636+00:00) securityworker stdout | 2022-11-28 08:04:15,948 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:04:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:47 UTC)" (scheduled at 2022-11-28 08:04:17.016425+00:00) gcworker stdout | 2022-11-28 08:04:17,052 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:04:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:32 UTC)" (scheduled at 2022-11-28 08:04:22.901291+00:00) notificationworker stdout | 2022-11-28 08:04:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:04:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:53 UTC)" (scheduled at 2022-11-28 08:04:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:04:23,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:04:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:04:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:04:24,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 08:04:24,506 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:24,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) gunicorn-web stdout | 2022-11-28 08:04:24,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:04:24,591 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:24,593 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.170 118 0.170) gunicorn-web stdout | 2022-11-28 08:04:24,650 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:04:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:42 UTC)" (scheduled at 2022-11-28 08:04:32.901291+00:00) notificationworker stdout | 2022-11-28 08:04:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:04:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:33 UTC)" (scheduled at 2022-11-28 08:04:33.026570+00:00) notificationworker stdout | 2022-11-28 08:04:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:04:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:33 UTC)" (scheduled at 2022-11-28 08:04:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:04:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:04:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:07 UTC)" (scheduled at 2022-11-28 08:04:37.716126+00:00) securityworker stdout | 2022-11-28 08:04:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:04:37,763 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:04:37,764 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:04:38,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:09:38 UTC)" (scheduled at 2022-11-28 08:04:38.024004+00:00) notificationworker stdout | 2022-11-28 08:04:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:09:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:04:39,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:04:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 08:04:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:04:39,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:39,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:04:39,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:04:39,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) gunicorn-web stdout | 2022-11-28 08:04:39,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:04:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:52 UTC)" (scheduled at 2022-11-28 08:04:42.901291+00:00) notificationworker stdout | 2022-11-28 08:04:42,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:04:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:04:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:15 UTC)" (scheduled at 2022-11-28 08:04:45.911636+00:00) securityworker stdout | 2022-11-28 08:04:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:04:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:17 UTC)" (scheduled at 2022-11-28 08:04:47.016425+00:00) gcworker stdout | 2022-11-28 08:04:47,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:04:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:50 UTC)" (scheduled at 2022-11-28 08:04:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:04:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:04:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:51 UTC)" (scheduled at 2022-11-28 08:04:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:04:51,763 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:04:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:02 UTC)" (scheduled at 2022-11-28 08:04:52.901291+00:00) notificationworker stdout | 2022-11-28 08:04:52,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:04:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:23 UTC)" (scheduled at 2022-11-28 08:04:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:04:53,157 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:04:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:04:54,495 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:54,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:54,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:04:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:04:54,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 08:04:54,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:04:54,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:04:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:56 UTC)" (scheduled at 2022-11-28 08:04:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:04:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:04:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:57 UTC)" (scheduled at 2022-11-28 08:04:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:04:57,583 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:05:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:05:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:12 UTC)" (scheduled at 2022-11-28 08:05:02.901291+00:00) notificationworker stdout | 2022-11-28 08:05:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:05:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:03 UTC)" (scheduled at 2022-11-28 08:05:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:05:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:05:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:06 UTC)" (scheduled at 2022-11-28 08:05:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:05:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:05:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:37 UTC)" (scheduled at 2022-11-28 08:05:07.716126+00:00) securityworker stdout | 2022-11-28 08:05:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:05:07,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:05:07,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:05:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:05:09,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:05:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:05:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 08:05:09,535 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) gunicorn-web stdout | 2022-11-28 08:05:09,536 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:05:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:22 UTC)" (scheduled at 2022-11-28 08:05:12.901291+00:00) notificationworker stdout | 2022-11-28 08:05:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:05:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:15 UTC)" (scheduled at 2022-11-28 08:05:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:05:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:05:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:45 UTC)" (scheduled at 2022-11-28 08:05:15.911636+00:00) securityworker stdout | 2022-11-28 08:05:15,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:05:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:47 UTC)" (scheduled at 2022-11-28 08:05:17.016425+00:00) gcworker stdout | 2022-11-28 08:05:17,046 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:05:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:32 UTC)" (scheduled at 2022-11-28 08:05:22.901291+00:00) notificationworker stdout | 2022-11-28 08:05:23,015 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:05:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:53 UTC)" (scheduled at 2022-11-28 08:05:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:05:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:05:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:05:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:05:24,499 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.001) gunicorn-web stdout | 2022-11-28 08:05:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.006) gunicorn-web stdout | 2022-11-28 08:05:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.001) gunicorn-web stdout | 2022-11-28 08:05:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:24,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) gunicorn-web stdout | 2022-11-28 08:05:24,635 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:05:24,646 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.174 118 0.174) notificationworker stdout | 2022-11-28 08:05:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:42 UTC)" (scheduled at 2022-11-28 08:05:32.901291+00:00) notificationworker stdout | 2022-11-28 08:05:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:05:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:33 UTC)" (scheduled at 2022-11-28 08:05:33.026570+00:00) notificationworker stdout | 2022-11-28 08:05:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:05:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:33 UTC)" (scheduled at 2022-11-28 08:05:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:05:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:05:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:07 UTC)" (scheduled at 2022-11-28 08:05:37.716126+00:00) securityworker stdout | 2022-11-28 08:05:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:05:37,805 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:05:37,806 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:05:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:05:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:05:39,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:39,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:05:39,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:39,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 08:05:39,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 08:05:39,556 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:05:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:10:41 UTC)" (scheduled at 2022-11-28 08:05:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:05:41,200 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:10:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:05:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:52 UTC)" (scheduled at 2022-11-28 08:05:42.901291+00:00) notificationworker stdout | 2022-11-28 08:05:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:05:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:05:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:15 UTC)" (scheduled at 2022-11-28 08:05:45.911636+00:00) securityworker stdout | 2022-11-28 08:05:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:05:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:17 UTC)" (scheduled at 2022-11-28 08:05:47.016425+00:00) gcworker stdout | 2022-11-28 08:05:47,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:05:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:10:48 UTC)" (scheduled at 2022-11-28 08:05:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:05:48,095 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:10:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:05:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:50 UTC)" (scheduled at 2022-11-28 08:05:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:05:50,155 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:05:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:51 UTC)" (scheduled at 2022-11-28 08:05:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:05:51,760 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:05:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:02 UTC)" (scheduled at 2022-11-28 08:05:52.901291+00:00) notificationworker stdout | 2022-11-28 08:05:52,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:05:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:23 UTC)" (scheduled at 2022-11-28 08:05:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:05:53,133 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:05:54,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:05:54,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:05:54,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:05:54,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:05:54,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:05:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:05:54,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:05:54,554 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) securityscanningnotificationworker stdout | 2022-11-28 08:05:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:56 UTC)" (scheduled at 2022-11-28 08:05:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:05:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:05:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:57 UTC)" (scheduled at 2022-11-28 08:05:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:05:57,559 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:06:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:06:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:12 UTC)" (scheduled at 2022-11-28 08:06:02.901291+00:00) notificationworker stdout | 2022-11-28 08:06:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:06:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:03 UTC)" (scheduled at 2022-11-28 08:06:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:06:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:06:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:06 UTC)" (scheduled at 2022-11-28 08:06:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:06:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:06:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:37 UTC)" (scheduled at 2022-11-28 08:06:07.716126+00:00) securityworker stdout | 2022-11-28 08:06:07,736 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:06:07,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:06:07,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:06:09,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:06:09,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:06:09,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:06:09,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:06:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:06:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:06:09,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:06:09,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) notificationworker stdout | 2022-11-28 08:06:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:22 UTC)" (scheduled at 2022-11-28 08:06:12.901291+00:00) notificationworker stdout | 2022-11-28 08:06:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:06:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:15 UTC)" (scheduled at 2022-11-28 08:06:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:06:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:06:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:45 UTC)" (scheduled at 2022-11-28 08:06:15.911636+00:00) securityworker stdout | 2022-11-28 08:06:15,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:06:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:47 UTC)" (scheduled at 2022-11-28 08:06:17.016425+00:00) gcworker stdout | 2022-11-28 08:06:17,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:06:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:32 UTC)" (scheduled at 2022-11-28 08:06:22.901291+00:00) notificationworker stdout | 2022-11-28 08:06:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:06:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:53 UTC)" (scheduled at 2022-11-28 08:06:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:06:23,139 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:06:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:06:24,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.006) gunicorn-registry stdout | 2022-11-28 08:06:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:06:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:06:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:06:24,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:06:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:06:24,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) gunicorn-web stdout | 2022-11-28 08:06:24,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 08:06:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:42 UTC)" (scheduled at 2022-11-28 08:06:32.901291+00:00) notificationworker stdout | 2022-11-28 08:06:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:06:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:33 UTC)" (scheduled at 2022-11-28 08:06:33.026570+00:00) notificationworker stdout | 2022-11-28 08:06:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:06:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:33 UTC)" (scheduled at 2022-11-28 08:06:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:06:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:06:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:07 UTC)" (scheduled at 2022-11-28 08:06:37.716126+00:00) securityworker stdout | 2022-11-28 08:06:37,737 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:06:37,780 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:06:37,782 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:06:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:06:39,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:06:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:06:39,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:06:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:06:39,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 08:06:39,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:06:39,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:06:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:52 UTC)" (scheduled at 2022-11-28 08:06:42.901291+00:00) notificationworker stdout | 2022-11-28 08:06:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:06:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:06:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:15 UTC)" (scheduled at 2022-11-28 08:06:45.911636+00:00) securityworker stdout | 2022-11-28 08:06:45,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:06:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:17 UTC)" (scheduled at 2022-11-28 08:06:47.016425+00:00) gcworker stdout | 2022-11-28 08:06:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:06:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:50 UTC)" (scheduled at 2022-11-28 08:06:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:06:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:06:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:51 UTC)" (scheduled at 2022-11-28 08:06:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:06:51,757 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:06:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:02 UTC)" (scheduled at 2022-11-28 08:06:52.901291+00:00) notificationworker stdout | 2022-11-28 08:06:52,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:06:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:23 UTC)" (scheduled at 2022-11-28 08:06:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:06:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:06:54,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:06:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:06:54,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:06:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:06:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:06:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:06:54,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:06:54,561 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) securityscanningnotificationworker stdout | 2022-11-28 08:06:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:56 UTC)" (scheduled at 2022-11-28 08:06:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:06:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:06:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:57 UTC)" (scheduled at 2022-11-28 08:06:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:06:57,554 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:07:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:07:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:12 UTC)" (scheduled at 2022-11-28 08:07:02.901291+00:00) notificationworker stdout | 2022-11-28 08:07:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:07:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:03 UTC)" (scheduled at 2022-11-28 08:07:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:07:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:07:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:06 UTC)" (scheduled at 2022-11-28 08:07:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:07:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:07:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:37 UTC)" (scheduled at 2022-11-28 08:07:07.716126+00:00) securityworker stdout | 2022-11-28 08:07:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:07:07,750 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:07:07,750 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:07:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:07:09,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:07:09,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:07:09,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:07:09,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:07:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 08:07:09,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:07:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) notificationworker stdout | 2022-11-28 08:07:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:22 UTC)" (scheduled at 2022-11-28 08:07:12.901291+00:00) notificationworker stdout | 2022-11-28 08:07:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:07:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:15 UTC)" (scheduled at 2022-11-28 08:07:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:07:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:07:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:45 UTC)" (scheduled at 2022-11-28 08:07:15.911636+00:00) securityworker stdout | 2022-11-28 08:07:15,970 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:07:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:47 UTC)" (scheduled at 2022-11-28 08:07:17.016425+00:00) gcworker stdout | 2022-11-28 08:07:17,043 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:07:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:32 UTC)" (scheduled at 2022-11-28 08:07:22.901291+00:00) notificationworker stdout | 2022-11-28 08:07:22,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:07:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:53 UTC)" (scheduled at 2022-11-28 08:07:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:07:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:07:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:07:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:07:24,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:07:24,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:07:24,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:07:24,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:07:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 08:07:24,576 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 08:07:24,586 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:07:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:42 UTC)" (scheduled at 2022-11-28 08:07:32.901291+00:00) notificationworker stdout | 2022-11-28 08:07:32,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:07:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:33 UTC)" (scheduled at 2022-11-28 08:07:33.026570+00:00) notificationworker stdout | 2022-11-28 08:07:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:07:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:33 UTC)" (scheduled at 2022-11-28 08:07:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:07:33,347 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:07:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:07 UTC)" (scheduled at 2022-11-28 08:07:37.716126+00:00) securityworker stdout | 2022-11-28 08:07:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:07:37,765 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:07:37,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:07:39,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:07:39,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 08:07:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:07:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:07:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:07:39,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 08:07:39,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:07:39,537 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:07:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:52 UTC)" (scheduled at 2022-11-28 08:07:42.901291+00:00) notificationworker stdout | 2022-11-28 08:07:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:07:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:07:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:15 UTC)" (scheduled at 2022-11-28 08:07:45.911636+00:00) securityworker stdout | 2022-11-28 08:07:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:07:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:17 UTC)" (scheduled at 2022-11-28 08:07:47.016425+00:00) gcworker stdout | 2022-11-28 08:07:47,085 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:07:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:50 UTC)" (scheduled at 2022-11-28 08:07:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:07:50,150 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:07:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:51 UTC)" (scheduled at 2022-11-28 08:07:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:07:51,763 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:07:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:02 UTC)" (scheduled at 2022-11-28 08:07:52.901291+00:00) notificationworker stdout | 2022-11-28 08:07:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:07:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:23 UTC)" (scheduled at 2022-11-28 08:07:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:07:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:07:54,484 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:07:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:07:54,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:07:54,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:07:54,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:07:54,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 08:07:54,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:07:54,580 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:07:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:56 UTC)" (scheduled at 2022-11-28 08:07:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:07:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:07:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:57 UTC)" (scheduled at 2022-11-28 08:07:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:07:57,597 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:08:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:08:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:12 UTC)" (scheduled at 2022-11-28 08:08:02.901291+00:00) notificationworker stdout | 2022-11-28 08:08:02,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:08:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:03 UTC)" (scheduled at 2022-11-28 08:08:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:08:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:08:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:06 UTC)" (scheduled at 2022-11-28 08:08:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:08:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:08:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:37 UTC)" (scheduled at 2022-11-28 08:08:07.716126+00:00) securityworker stdout | 2022-11-28 08:08:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:08:07,802 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:08:07,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:08:09,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:08:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:08:09,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:08:09,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:08:09,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:08:09,513 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:08:09,544 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:08:09,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:08:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:22 UTC)" (scheduled at 2022-11-28 08:08:12.901291+00:00) notificationworker stdout | 2022-11-28 08:08:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:08:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:15 UTC)" (scheduled at 2022-11-28 08:08:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:08:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:08:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:45 UTC)" (scheduled at 2022-11-28 08:08:15.911636+00:00) securityworker stdout | 2022-11-28 08:08:15,980 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:08:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:47 UTC)" (scheduled at 2022-11-28 08:08:17.016425+00:00) gcworker stdout | 2022-11-28 08:08:17,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:08:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:32 UTC)" (scheduled at 2022-11-28 08:08:22.901291+00:00) notificationworker stdout | 2022-11-28 08:08:22,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:08:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:53 UTC)" (scheduled at 2022-11-28 08:08:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:08:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:08:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:08:24,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:08:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:08:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:08:24,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:08:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:08:24,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:08:24,588 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 08:08:24,606 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.134) notificationworker stdout | 2022-11-28 08:08:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:42 UTC)" (scheduled at 2022-11-28 08:08:32.901291+00:00) notificationworker stdout | 2022-11-28 08:08:32,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:08:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:33 UTC)" (scheduled at 2022-11-28 08:08:33.026570+00:00) notificationworker stdout | 2022-11-28 08:08:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:08:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:33 UTC)" (scheduled at 2022-11-28 08:08:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:08:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:08:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:07 UTC)" (scheduled at 2022-11-28 08:08:37.716126+00:00) securityworker stdout | 2022-11-28 08:08:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:08:37,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:08:37,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:08:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:13:38 UTC)" (scheduled at 2022-11-28 08:08:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:08:38,464 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:13:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:08:39,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:08:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:08:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:08:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:08:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:08:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:08:39,545 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:08:39,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:08:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:52 UTC)" (scheduled at 2022-11-28 08:08:42.901291+00:00) notificationworker stdout | 2022-11-28 08:08:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:08:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:08:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:15 UTC)" (scheduled at 2022-11-28 08:08:45.911636+00:00) securityworker stdout | 2022-11-28 08:08:45,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:08:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:17 UTC)" (scheduled at 2022-11-28 08:08:47.016425+00:00) gcworker stdout | 2022-11-28 08:08:47,101 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:08:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:13:49 UTC)" (scheduled at 2022-11-28 08:08:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:08:49,445 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:13:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:08:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:50 UTC)" (scheduled at 2022-11-28 08:08:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:08:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:08:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:51 UTC)" (scheduled at 2022-11-28 08:08:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:08:51,763 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:08:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:02 UTC)" (scheduled at 2022-11-28 08:08:52.901291+00:00) notificationworker stdout | 2022-11-28 08:08:52,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:08:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:23 UTC)" (scheduled at 2022-11-28 08:08:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:08:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:08:54,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:08:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:08:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:08:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:08:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:08:54,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:08:54,547 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:08:54,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) securityscanningnotificationworker stdout | 2022-11-28 08:08:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:56 UTC)" (scheduled at 2022-11-28 08:08:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:08:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:08:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:57 UTC)" (scheduled at 2022-11-28 08:08:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:08:57,543 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:09:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:09:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:12 UTC)" (scheduled at 2022-11-28 08:09:02.901291+00:00) notificationworker stdout | 2022-11-28 08:09:02,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:09:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:03 UTC)" (scheduled at 2022-11-28 08:09:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:09:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:09:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:06 UTC)" (scheduled at 2022-11-28 08:09:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:09:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:09:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:37 UTC)" (scheduled at 2022-11-28 08:09:07.716126+00:00) securityworker stdout | 2022-11-28 08:09:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:09:07,778 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:09:07,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:09:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:09:09,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:09:09,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:09:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:09:09,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:09:09,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:09:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:22 UTC)" (scheduled at 2022-11-28 08:09:12.901291+00:00) notificationworker stdout | 2022-11-28 08:09:12,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:09:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:15 UTC)" (scheduled at 2022-11-28 08:09:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:09:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:09:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:45 UTC)" (scheduled at 2022-11-28 08:09:15.911636+00:00) securityworker stdout | 2022-11-28 08:09:15,987 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:09:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:47 UTC)" (scheduled at 2022-11-28 08:09:17.016425+00:00) gcworker stdout | 2022-11-28 08:09:17,052 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:09:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:32 UTC)" (scheduled at 2022-11-28 08:09:22.901291+00:00) notificationworker stdout | 2022-11-28 08:09:22,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:09:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:53 UTC)" (scheduled at 2022-11-28 08:09:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:09:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:09:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:09:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.013) gunicorn-web stdout | 2022-11-28 08:09:24,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:09:24,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:09:24,506 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 08:09:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:24,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:09:24,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.101) gunicorn-web stdout | 2022-11-28 08:09:24,574 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:09:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:42 UTC)" (scheduled at 2022-11-28 08:09:32.901291+00:00) notificationworker stdout | 2022-11-28 08:09:32,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:09:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:33 UTC)" (scheduled at 2022-11-28 08:09:33.026570+00:00) notificationworker stdout | 2022-11-28 08:09:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:09:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:33 UTC)" (scheduled at 2022-11-28 08:09:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:09:33,389 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:09:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:07 UTC)" (scheduled at 2022-11-28 08:09:37.716126+00:00) securityworker stdout | 2022-11-28 08:09:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:09:37,782 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:09:37,783 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:09:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:14:38 UTC)" (scheduled at 2022-11-28 08:09:38.024004+00:00) notificationworker stdout | 2022-11-28 08:09:38,102 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:14:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:09:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:09:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 08:09:39,520 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:39,520 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:09:39,526 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 08:09:39,568 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:09:39,569 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) gunicorn-web stdout | 2022-11-28 08:09:39,612 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:09:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:52 UTC)" (scheduled at 2022-11-28 08:09:42.901291+00:00) notificationworker stdout | 2022-11-28 08:09:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:09:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:09:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:15 UTC)" (scheduled at 2022-11-28 08:09:45.911636+00:00) securityworker stdout | 2022-11-28 08:09:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:09:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:17 UTC)" (scheduled at 2022-11-28 08:09:47.016425+00:00) gcworker stdout | 2022-11-28 08:09:47,045 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:09:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:50 UTC)" (scheduled at 2022-11-28 08:09:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:09:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:09:51,739 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:51 UTC)" (scheduled at 2022-11-28 08:09:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:09:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:09:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:02 UTC)" (scheduled at 2022-11-28 08:09:52.901291+00:00) notificationworker stdout | 2022-11-28 08:09:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:09:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:23 UTC)" (scheduled at 2022-11-28 08:09:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:09:53,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:09:54,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.002) gunicorn-registry stdout | 2022-11-28 08:09:54,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:09:54,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:54,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:09:54,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:09:54,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 08:09:54,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 08:09:54,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:09:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:56 UTC)" (scheduled at 2022-11-28 08:09:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:09:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:09:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:57 UTC)" (scheduled at 2022-11-28 08:09:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:09:57,616 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:10:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:10:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:12 UTC)" (scheduled at 2022-11-28 08:10:02.901291+00:00) notificationworker stdout | 2022-11-28 08:10:02,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:10:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:03 UTC)" (scheduled at 2022-11-28 08:10:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:10:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:10:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:06 UTC)" (scheduled at 2022-11-28 08:10:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:10:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:10:07,721 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:37 UTC)" (scheduled at 2022-11-28 08:10:07.716126+00:00) securityworker stdout | 2022-11-28 08:10:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:10:07,773 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:10:07,774 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:10:09,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:09,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:10:09,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:10:09,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:10:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:10:09,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) gunicorn-web stdout | 2022-11-28 08:10:09,607 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:10:09,612 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) notificationworker stdout | 2022-11-28 08:10:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:22 UTC)" (scheduled at 2022-11-28 08:10:12.901291+00:00) notificationworker stdout | 2022-11-28 08:10:12,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:10:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:15 UTC)" (scheduled at 2022-11-28 08:10:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:10:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:10:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:45 UTC)" (scheduled at 2022-11-28 08:10:15.911636+00:00) securityworker stdout | 2022-11-28 08:10:16,022 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:10:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:47 UTC)" (scheduled at 2022-11-28 08:10:17.016425+00:00) gcworker stdout | 2022-11-28 08:10:17,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:10:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:32 UTC)" (scheduled at 2022-11-28 08:10:22.901291+00:00) notificationworker stdout | 2022-11-28 08:10:23,011 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:10:23,118 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:53 UTC)" (scheduled at 2022-11-28 08:10:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:10:23,177 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:10:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:10:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:10:24,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:10:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:10:24,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:24,522 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) gunicorn-web stdout | 2022-11-28 08:10:24,607 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:10:24,663 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.191 118 0.191) notificationworker stdout | 2022-11-28 08:10:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:42 UTC)" (scheduled at 2022-11-28 08:10:32.901291+00:00) notificationworker stdout | 2022-11-28 08:10:32,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:10:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:33 UTC)" (scheduled at 2022-11-28 08:10:33.026570+00:00) notificationworker stdout | 2022-11-28 08:10:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:10:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:33 UTC)" (scheduled at 2022-11-28 08:10:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:10:33,373 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:10:37,721 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:07 UTC)" (scheduled at 2022-11-28 08:10:37.716126+00:00) securityworker stdout | 2022-11-28 08:10:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:10:37,767 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:10:37,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:10:39,486 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-web stdout | 2022-11-28 08:10:39,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:10:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:10:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:10:39,506 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:39,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 08:10:39,576 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) securityscanningnotificationworker stdout | 2022-11-28 08:10:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:15:41 UTC)" (scheduled at 2022-11-28 08:10:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:10:41,218 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:15:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:10:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:52 UTC)" (scheduled at 2022-11-28 08:10:42.901291+00:00) notificationworker stdout | 2022-11-28 08:10:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:10:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:10:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:15 UTC)" (scheduled at 2022-11-28 08:10:45.911636+00:00) securityworker stdout | 2022-11-28 08:10:46,027 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:10:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:17 UTC)" (scheduled at 2022-11-28 08:10:47.016425+00:00) gcworker stdout | 2022-11-28 08:10:47,094 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:10:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:15:48 UTC)" (scheduled at 2022-11-28 08:10:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:10:48,093 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:15:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:10:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:50 UTC)" (scheduled at 2022-11-28 08:10:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:10:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:10:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:51 UTC)" (scheduled at 2022-11-28 08:10:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:10:51,820 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:10:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:02 UTC)" (scheduled at 2022-11-28 08:10:52.901291+00:00) notificationworker stdout | 2022-11-28 08:10:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:10:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:23 UTC)" (scheduled at 2022-11-28 08:10:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:10:53,175 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:10:54,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:10:54,485 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:10:54,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:10:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:10:54,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:10:54,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:10:54,610 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.147 118 0.147) gunicorn-web stdout | 2022-11-28 08:10:54,620 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:10:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:56 UTC)" (scheduled at 2022-11-28 08:10:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:10:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:10:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:57 UTC)" (scheduled at 2022-11-28 08:10:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:10:57,588 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:11:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:11:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:12 UTC)" (scheduled at 2022-11-28 08:11:02.901291+00:00) notificationworker stdout | 2022-11-28 08:11:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:11:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:03 UTC)" (scheduled at 2022-11-28 08:11:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:11:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:11:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:06 UTC)" (scheduled at 2022-11-28 08:11:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:11:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:11:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:37 UTC)" (scheduled at 2022-11-28 08:11:07.716126+00:00) securityworker stdout | 2022-11-28 08:11:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:11:07,764 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:11:07,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:11:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:11:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:09,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:09,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:11:09,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:09,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:11:09,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:11:09,540 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) notificationworker stdout | 2022-11-28 08:11:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:22 UTC)" (scheduled at 2022-11-28 08:11:12.901291+00:00) notificationworker stdout | 2022-11-28 08:11:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:11:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:15 UTC)" (scheduled at 2022-11-28 08:11:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:11:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:11:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:45 UTC)" (scheduled at 2022-11-28 08:11:15.911636+00:00) securityworker stdout | 2022-11-28 08:11:15,995 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:11:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:47 UTC)" (scheduled at 2022-11-28 08:11:17.016425+00:00) gcworker stdout | 2022-11-28 08:11:17,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:11:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:32 UTC)" (scheduled at 2022-11-28 08:11:22.901291+00:00) notificationworker stdout | 2022-11-28 08:11:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:11:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:53 UTC)" (scheduled at 2022-11-28 08:11:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:11:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:11:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:11:24,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:11:24,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:11:24,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:24,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:11:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:11:24,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:11:24,575 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) notificationworker stdout | 2022-11-28 08:11:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:42 UTC)" (scheduled at 2022-11-28 08:11:32.901291+00:00) notificationworker stdout | 2022-11-28 08:11:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:11:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:33 UTC)" (scheduled at 2022-11-28 08:11:33.026570+00:00) notificationworker stdout | 2022-11-28 08:11:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:11:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:33 UTC)" (scheduled at 2022-11-28 08:11:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:11:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:11:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:07 UTC)" (scheduled at 2022-11-28 08:11:37.716126+00:00) securityworker stdout | 2022-11-28 08:11:37,736 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:11:37,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:11:37,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:11:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:11:39,487 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:11:39,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:39,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:11:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:39,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:11:39,554 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:11:39,557 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) notificationworker stdout | 2022-11-28 08:11:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:52 UTC)" (scheduled at 2022-11-28 08:11:42.901291+00:00) notificationworker stdout | 2022-11-28 08:11:42,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:11:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:11:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:15 UTC)" (scheduled at 2022-11-28 08:11:45.911636+00:00) securityworker stdout | 2022-11-28 08:11:46,080 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:11:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:17 UTC)" (scheduled at 2022-11-28 08:11:47.016425+00:00) gcworker stdout | 2022-11-28 08:11:47,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:11:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:50 UTC)" (scheduled at 2022-11-28 08:11:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:11:50,181 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:11:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:51 UTC)" (scheduled at 2022-11-28 08:11:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:11:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:11:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:02 UTC)" (scheduled at 2022-11-28 08:11:52.901291+00:00) notificationworker stdout | 2022-11-28 08:11:52,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:11:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:23 UTC)" (scheduled at 2022-11-28 08:11:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:11:53,165 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:11:54,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:11:54,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:11:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:54,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:11:54,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:11:54,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:11:54,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 08:11:54,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:11:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:56 UTC)" (scheduled at 2022-11-28 08:11:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:11:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:11:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:57 UTC)" (scheduled at 2022-11-28 08:11:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:11:57,583 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:12:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:12:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:12 UTC)" (scheduled at 2022-11-28 08:12:02.901291+00:00) notificationworker stdout | 2022-11-28 08:12:02,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:12:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:03 UTC)" (scheduled at 2022-11-28 08:12:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:12:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:12:06,426 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:06 UTC)" (scheduled at 2022-11-28 08:12:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:12:06,427 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:12:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:37 UTC)" (scheduled at 2022-11-28 08:12:07.716126+00:00) securityworker stdout | 2022-11-28 08:12:07,798 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:12:07,882 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:12:07,882 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:12:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:12:09,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:12:09,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:09,515 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:12:09,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:09,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:12:09,553 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:12:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:12:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:22 UTC)" (scheduled at 2022-11-28 08:12:12.901291+00:00) notificationworker stdout | 2022-11-28 08:12:12,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:12:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:15 UTC)" (scheduled at 2022-11-28 08:12:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:12:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:12:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:45 UTC)" (scheduled at 2022-11-28 08:12:15.911636+00:00) securityworker stdout | 2022-11-28 08:12:15,972 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:12:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:47 UTC)" (scheduled at 2022-11-28 08:12:17.016425+00:00) gcworker stdout | 2022-11-28 08:12:17,104 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:12:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:32 UTC)" (scheduled at 2022-11-28 08:12:22.901291+00:00) notificationworker stdout | 2022-11-28 08:12:22,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:12:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:53 UTC)" (scheduled at 2022-11-28 08:12:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:12:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:12:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.008) gunicorn-registry stdout | 2022-11-28 08:12:24,497 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:12:24,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:12:24,509 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:12:24,521 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:24,525 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:12:24,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 08:12:24,599 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:12:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:42 UTC)" (scheduled at 2022-11-28 08:12:32.901291+00:00) notificationworker stdout | 2022-11-28 08:12:32,993 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:12:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:33 UTC)" (scheduled at 2022-11-28 08:12:33.026570+00:00) notificationworker stdout | 2022-11-28 08:12:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:12:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:33 UTC)" (scheduled at 2022-11-28 08:12:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:12:33,380 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:12:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:07 UTC)" (scheduled at 2022-11-28 08:12:37.716126+00:00) securityworker stdout | 2022-11-28 08:12:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:12:37,782 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:12:37,783 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:12:39,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:12:39,486 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:12:39,491 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:39,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:12:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:39,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:12:39,554 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:12:39,580 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:12:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:52 UTC)" (scheduled at 2022-11-28 08:12:42.901291+00:00) notificationworker stdout | 2022-11-28 08:12:42,923 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:12:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:12:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:15 UTC)" (scheduled at 2022-11-28 08:12:45.911636+00:00) securityworker stdout | 2022-11-28 08:12:46,048 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:12:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:17 UTC)" (scheduled at 2022-11-28 08:12:47.016425+00:00) gcworker stdout | 2022-11-28 08:12:47,087 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:12:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:50 UTC)" (scheduled at 2022-11-28 08:12:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:12:50,224 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:12:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:51 UTC)" (scheduled at 2022-11-28 08:12:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:12:51,802 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:12:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:02 UTC)" (scheduled at 2022-11-28 08:12:52.901291+00:00) notificationworker stdout | 2022-11-28 08:12:52,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:12:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:23 UTC)" (scheduled at 2022-11-28 08:12:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:12:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:12:54,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:12:54,487 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:12:54,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:54,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:12:54,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:12:54,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:12:54,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 08:12:54,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:12:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:56 UTC)" (scheduled at 2022-11-28 08:12:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:12:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:12:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:57 UTC)" (scheduled at 2022-11-28 08:12:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:12:57,581 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:13:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:13:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:12 UTC)" (scheduled at 2022-11-28 08:13:02.901291+00:00) notificationworker stdout | 2022-11-28 08:13:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:13:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:03 UTC)" (scheduled at 2022-11-28 08:13:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:13:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:13:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:06 UTC)" (scheduled at 2022-11-28 08:13:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:13:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:13:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:37 UTC)" (scheduled at 2022-11-28 08:13:07.716126+00:00) securityworker stdout | 2022-11-28 08:13:07,751 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:13:07,864 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:13:07,866 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:13:09,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:13:09,490 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:13:09,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:09,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:13:09,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:09,519 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:13:09,542 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:13:09,555 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:13:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:22 UTC)" (scheduled at 2022-11-28 08:13:12.901291+00:00) notificationworker stdout | 2022-11-28 08:13:12,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:13:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:15 UTC)" (scheduled at 2022-11-28 08:13:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:13:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:13:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:45 UTC)" (scheduled at 2022-11-28 08:13:15.911636+00:00) securityworker stdout | 2022-11-28 08:13:16,008 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:13:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:47 UTC)" (scheduled at 2022-11-28 08:13:17.016425+00:00) gcworker stdout | 2022-11-28 08:13:17,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:13:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:32 UTC)" (scheduled at 2022-11-28 08:13:22.901291+00:00) notificationworker stdout | 2022-11-28 08:13:22,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:13:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:53 UTC)" (scheduled at 2022-11-28 08:13:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:13:23,165 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:13:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:13:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:13:24,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:13:24,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:24,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 159 0.013) gunicorn-web stdout | 2022-11-28 08:13:24,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:13:24,707 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.233 118 0.233) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.236 118 0.236) gunicorn-web stdout | 2022-11-28 08:13:24,708 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:13:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:42 UTC)" (scheduled at 2022-11-28 08:13:32.901291+00:00) notificationworker stdout | 2022-11-28 08:13:32,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:13:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:33 UTC)" (scheduled at 2022-11-28 08:13:33.026570+00:00) notificationworker stdout | 2022-11-28 08:13:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:13:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:33 UTC)" (scheduled at 2022-11-28 08:13:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:13:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:13:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:07 UTC)" (scheduled at 2022-11-28 08:13:37.716126+00:00) securityworker stdout | 2022-11-28 08:13:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:13:37,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:13:37,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:13:38,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:18:38 UTC)" (scheduled at 2022-11-28 08:13:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:13:38,518 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:18:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:13:39,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:13:39,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:13:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:13:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:13:39,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:13:39,549 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 08:13:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:52 UTC)" (scheduled at 2022-11-28 08:13:42.901291+00:00) notificationworker stdout | 2022-11-28 08:13:42,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:13:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:13:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:15 UTC)" (scheduled at 2022-11-28 08:13:45.911636+00:00) securityworker stdout | 2022-11-28 08:13:46,038 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:13:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:17 UTC)" (scheduled at 2022-11-28 08:13:47.016425+00:00) gcworker stdout | 2022-11-28 08:13:47,120 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:13:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:18:49 UTC)" (scheduled at 2022-11-28 08:13:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:13:49,468 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:18:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:13:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:50 UTC)" (scheduled at 2022-11-28 08:13:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:13:50,236 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:13:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:51 UTC)" (scheduled at 2022-11-28 08:13:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:13:51,789 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:13:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:02 UTC)" (scheduled at 2022-11-28 08:13:52.901291+00:00) notificationworker stdout | 2022-11-28 08:13:53,008 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:13:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:23 UTC)" (scheduled at 2022-11-28 08:13:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:13:53,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:13:54,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 08:13:54,500 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:13:54,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:13:54,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:13:54,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:13:54,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.194 118 0.194) gunicorn-web stdout | 2022-11-28 08:13:54,668 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:13:54,712 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.238 118 0.238) securityscanningnotificationworker stdout | 2022-11-28 08:13:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:56 UTC)" (scheduled at 2022-11-28 08:13:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:13:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:13:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:57 UTC)" (scheduled at 2022-11-28 08:13:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:13:57,609 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:14:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:14:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:12 UTC)" (scheduled at 2022-11-28 08:14:02.901291+00:00) notificationworker stdout | 2022-11-28 08:14:02,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:14:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:03 UTC)" (scheduled at 2022-11-28 08:14:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:14:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:14:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:06 UTC)" (scheduled at 2022-11-28 08:14:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:14:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:14:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:37 UTC)" (scheduled at 2022-11-28 08:14:07.716126+00:00) securityworker stdout | 2022-11-28 08:14:07,746 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:14:07,864 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:14:07,865 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 08:14:09,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.021 162 0.021) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.010) gunicorn-web stdout | 2022-11-28 08:14:09,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:09,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:14:09,511 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:14:09,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:09,517 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.163 118 0.163) gunicorn-web stdout | 2022-11-28 08:14:09,635 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.198 118 0.198) gunicorn-web stdout | 2022-11-28 08:14:09,670 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:14:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:22 UTC)" (scheduled at 2022-11-28 08:14:12.901291+00:00) notificationworker stdout | 2022-11-28 08:14:13,011 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:14:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:15 UTC)" (scheduled at 2022-11-28 08:14:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:14:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:14:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:45 UTC)" (scheduled at 2022-11-28 08:14:15.911636+00:00) securityworker stdout | 2022-11-28 08:14:15,994 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:14:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:47 UTC)" (scheduled at 2022-11-28 08:14:17.016425+00:00) gcworker stdout | 2022-11-28 08:14:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:14:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:32 UTC)" (scheduled at 2022-11-28 08:14:22.901291+00:00) notificationworker stdout | 2022-11-28 08:14:23,016 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:14:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:53 UTC)" (scheduled at 2022-11-28 08:14:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:14:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:14:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:14:24,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:14:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:24,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:14:24,507 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:24,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:14:24,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:14:24,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 08:14:24,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:14:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:42 UTC)" (scheduled at 2022-11-28 08:14:32.901291+00:00) notificationworker stdout | 2022-11-28 08:14:32,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:14:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:33 UTC)" (scheduled at 2022-11-28 08:14:33.026570+00:00) notificationworker stdout | 2022-11-28 08:14:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:14:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:33 UTC)" (scheduled at 2022-11-28 08:14:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:14:33,442 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:14:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:07 UTC)" (scheduled at 2022-11-28 08:14:37.716126+00:00) securityworker stdout | 2022-11-28 08:14:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:14:37,842 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:14:37,843 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:14:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:19:38 UTC)" (scheduled at 2022-11-28 08:14:38.024004+00:00) notificationworker stdout | 2022-11-28 08:14:38,106 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:19:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:14:39,486 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:14:39,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:14:39,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:14:39,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 08:14:39,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:14:39,545 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) notificationworker stdout | 2022-11-28 08:14:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:52 UTC)" (scheduled at 2022-11-28 08:14:42.901291+00:00) notificationworker stdout | 2022-11-28 08:14:43,020 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:14:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:14:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:15 UTC)" (scheduled at 2022-11-28 08:14:45.911636+00:00) securityworker stdout | 2022-11-28 08:14:45,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:14:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:17 UTC)" (scheduled at 2022-11-28 08:14:47.016425+00:00) gcworker stdout | 2022-11-28 08:14:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:14:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:50 UTC)" (scheduled at 2022-11-28 08:14:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:14:50,177 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:14:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:51 UTC)" (scheduled at 2022-11-28 08:14:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:14:51,788 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:14:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:02 UTC)" (scheduled at 2022-11-28 08:14:52.901291+00:00) notificationworker stdout | 2022-11-28 08:14:52,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:14:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:23 UTC)" (scheduled at 2022-11-28 08:14:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:14:53,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:14:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:14:54,490 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:14:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:14:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:14:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.095) gunicorn-web stdout | 2022-11-28 08:14:54,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:14:54,581 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) securityscanningnotificationworker stdout | 2022-11-28 08:14:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:56 UTC)" (scheduled at 2022-11-28 08:14:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:14:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:14:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:57 UTC)" (scheduled at 2022-11-28 08:14:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:14:57,648 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:15:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:12 UTC)" (scheduled at 2022-11-28 08:15:02.901291+00:00) notificationworker stdout | 2022-11-28 08:15:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:15:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:03 UTC)" (scheduled at 2022-11-28 08:15:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:15:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:15:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:06 UTC)" (scheduled at 2022-11-28 08:15:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:15:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:15:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:37 UTC)" (scheduled at 2022-11-28 08:15:07.716126+00:00) securityworker stdout | 2022-11-28 08:15:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:15:07,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:15:07,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:15:09,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:15:09,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:15:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:09,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.003) gunicorn-web stdout | 2022-11-28 08:15:09,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:15:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) gunicorn-web stdout | 2022-11-28 08:15:09,618 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.214 118 0.214) gunicorn-web stdout | 2022-11-28 08:15:09,687 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" globalpromstats stdout | 2022-11-28 08:15:12,518 [66] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 09:15:12 UTC)" (scheduled at 2022-11-28 08:15:12.517266+00:00) globalpromstats stdout | 2022-11-28 08:15:12,521 [66] [INFO] [redis_lock.acquire] Got lock for 'lock:GLOBAL_PROM_STATS'. globalpromstats stdout | 2022-11-28 08:15:12,615 [66] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 09:15:12 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:22 UTC)" (scheduled at 2022-11-28 08:15:12.901291+00:00) notificationworker stdout | 2022-11-28 08:15:12,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:15:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:15 UTC)" (scheduled at 2022-11-28 08:15:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:15:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:15:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:45 UTC)" (scheduled at 2022-11-28 08:15:15.911636+00:00) securityworker stdout | 2022-11-28 08:15:16,014 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:15:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:47 UTC)" (scheduled at 2022-11-28 08:15:17.016425+00:00) gcworker stdout | 2022-11-28 08:15:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:32 UTC)" (scheduled at 2022-11-28 08:15:22.901291+00:00) notificationworker stdout | 2022-11-28 08:15:22,976 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:15:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:53 UTC)" (scheduled at 2022-11-28 08:15:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:15:23,175 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:15:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:15:24,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:15:24,501 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:15:24,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:15:24,518 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:24,523 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 08:15:24,590 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 08:15:24,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:15:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:42 UTC)" (scheduled at 2022-11-28 08:15:32.901291+00:00) notificationworker stdout | 2022-11-28 08:15:32,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:33 UTC)" (scheduled at 2022-11-28 08:15:33.026570+00:00) notificationworker stdout | 2022-11-28 08:15:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:15:33,334 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:33 UTC)" (scheduled at 2022-11-28 08:15:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:15:33,382 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:15:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:07 UTC)" (scheduled at 2022-11-28 08:15:37.716126+00:00) securityworker stdout | 2022-11-28 08:15:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:15:37,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:15:37,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:15:39,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.001) gunicorn-registry stdout | 2022-11-28 08:15:39,498 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:15:39,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 08:15:39,517 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:39,522 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:15:39,574 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:15:39,576 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) securityscanningnotificationworker stdout | 2022-11-28 08:15:41,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:20:41 UTC)" (scheduled at 2022-11-28 08:15:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:15:41,209 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:20:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:52 UTC)" (scheduled at 2022-11-28 08:15:42.901291+00:00) notificationworker stdout | 2022-11-28 08:15:42,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:15:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:15:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:15 UTC)" (scheduled at 2022-11-28 08:15:45.911636+00:00) securityworker stdout | 2022-11-28 08:15:45,955 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:15:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:17 UTC)" (scheduled at 2022-11-28 08:15:47.016425+00:00) gcworker stdout | 2022-11-28 08:15:47,079 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:15:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:20:48 UTC)" (scheduled at 2022-11-28 08:15:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:15:48,089 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:20:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:15:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:50 UTC)" (scheduled at 2022-11-28 08:15:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:15:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:15:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:51 UTC)" (scheduled at 2022-11-28 08:15:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:15:51,796 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:15:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:02 UTC)" (scheduled at 2022-11-28 08:15:52.901291+00:00) notificationworker stdout | 2022-11-28 08:15:52,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:15:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:23 UTC)" (scheduled at 2022-11-28 08:15:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:15:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:15:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:15:54,503 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:15:54,518 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:15:54,520 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:15:54,522 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:15:54,525 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) gunicorn-web stdout | 2022-11-28 08:15:54,609 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:15:54,638 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.164 118 0.164) securityscanningnotificationworker stdout | 2022-11-28 08:15:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:56 UTC)" (scheduled at 2022-11-28 08:15:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:15:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:15:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:57 UTC)" (scheduled at 2022-11-28 08:15:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:15:57,636 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:16:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:16:02,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:12 UTC)" (scheduled at 2022-11-28 08:16:02.901291+00:00) notificationworker stdout | 2022-11-28 08:16:02,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:16:03,409 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:03 UTC)" (scheduled at 2022-11-28 08:16:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:16:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:16:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:06 UTC)" (scheduled at 2022-11-28 08:16:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:16:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:16:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:37 UTC)" (scheduled at 2022-11-28 08:16:07.716126+00:00) securityworker stdout | 2022-11-28 08:16:07,719 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:16:07,750 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:16:07,750 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:16:09,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:16:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:16:09,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:16:09,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:09,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:16:09,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:16:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 08:16:09,563 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 08:16:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:22 UTC)" (scheduled at 2022-11-28 08:16:12.901291+00:00) notificationworker stdout | 2022-11-28 08:16:13,013 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:16:15,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:15 UTC)" (scheduled at 2022-11-28 08:16:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:16:15,039 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:16:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:45 UTC)" (scheduled at 2022-11-28 08:16:15.911636+00:00) securityworker stdout | 2022-11-28 08:16:16,024 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:16:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:47 UTC)" (scheduled at 2022-11-28 08:16:17.016425+00:00) gcworker stdout | 2022-11-28 08:16:17,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:16:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:32 UTC)" (scheduled at 2022-11-28 08:16:22.901291+00:00) notificationworker stdout | 2022-11-28 08:16:22,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:16:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:53 UTC)" (scheduled at 2022-11-28 08:16:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:16:23,188 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:16:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:16:24,496 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:16:24,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:16:24,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:16:24,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:24,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) gunicorn-web stdout | 2022-11-28 08:16:24,599 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.129) gunicorn-web stdout | 2022-11-28 08:16:24,602 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:16:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:42 UTC)" (scheduled at 2022-11-28 08:16:32.901291+00:00) notificationworker stdout | 2022-11-28 08:16:32,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:16:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:33 UTC)" (scheduled at 2022-11-28 08:16:33.026570+00:00) notificationworker stdout | 2022-11-28 08:16:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:16:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:33 UTC)" (scheduled at 2022-11-28 08:16:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:16:33,381 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:16:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:07 UTC)" (scheduled at 2022-11-28 08:16:37.716126+00:00) securityworker stdout | 2022-11-28 08:16:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:16:37,778 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:16:37,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:16:39,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:16:39,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:39,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:16:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:16:39,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:16:39,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:16:39,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:16:39,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) notificationworker stdout | 2022-11-28 08:16:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:52 UTC)" (scheduled at 2022-11-28 08:16:42.901291+00:00) notificationworker stdout | 2022-11-28 08:16:43,024 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:16:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:16:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:15 UTC)" (scheduled at 2022-11-28 08:16:45.911636+00:00) securityworker stdout | 2022-11-28 08:16:46,204 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:16:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:17 UTC)" (scheduled at 2022-11-28 08:16:47.016425+00:00) gcworker stdout | 2022-11-28 08:16:47,098 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:16:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:50 UTC)" (scheduled at 2022-11-28 08:16:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:16:50,240 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:16:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:51 UTC)" (scheduled at 2022-11-28 08:16:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:16:51,827 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:16:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:02 UTC)" (scheduled at 2022-11-28 08:16:52.901291+00:00) notificationworker stdout | 2022-11-28 08:16:52,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:16:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:23 UTC)" (scheduled at 2022-11-28 08:16:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:16:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:16:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:16:54,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:16:54,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:16:54,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:16:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.167 118 0.167) gunicorn-web stdout | 2022-11-28 08:16:54,641 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:16:54,649 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.176 118 0.176) securityscanningnotificationworker stdout | 2022-11-28 08:16:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:56 UTC)" (scheduled at 2022-11-28 08:16:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:16:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:16:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:57 UTC)" (scheduled at 2022-11-28 08:16:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:16:57,646 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:17:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:17:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:12 UTC)" (scheduled at 2022-11-28 08:17:02.901291+00:00) notificationworker stdout | 2022-11-28 08:17:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:17:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:03 UTC)" (scheduled at 2022-11-28 08:17:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:17:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:17:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:06 UTC)" (scheduled at 2022-11-28 08:17:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:17:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:17:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:37 UTC)" (scheduled at 2022-11-28 08:17:07.716126+00:00) securityworker stdout | 2022-11-28 08:17:07,748 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:17:07,834 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:17:07,834 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:17:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:17:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:17:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:17:09,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:09,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:17:09,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 08:17:09,591 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:17:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:22 UTC)" (scheduled at 2022-11-28 08:17:12.901291+00:00) notificationworker stdout | 2022-11-28 08:17:12,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:17:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:15 UTC)" (scheduled at 2022-11-28 08:17:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:17:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:17:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:45 UTC)" (scheduled at 2022-11-28 08:17:15.911636+00:00) securityworker stdout | 2022-11-28 08:17:15,971 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:17:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:47 UTC)" (scheduled at 2022-11-28 08:17:17.016425+00:00) gcworker stdout | 2022-11-28 08:17:17,086 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:17:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:32 UTC)" (scheduled at 2022-11-28 08:17:22.901291+00:00) notificationworker stdout | 2022-11-28 08:17:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:17:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:53 UTC)" (scheduled at 2022-11-28 08:17:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:17:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:17:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:17:24,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:17:24,483 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:17:24,491 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:24,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:17:24,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:17:24,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.295 118 0.295) gunicorn-web stdout | 2022-11-28 08:17:24,768 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.298 118 0.298) gunicorn-web stdout | 2022-11-28 08:17:24,771 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:17:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:42 UTC)" (scheduled at 2022-11-28 08:17:32.901291+00:00) notificationworker stdout | 2022-11-28 08:17:32,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:17:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:33 UTC)" (scheduled at 2022-11-28 08:17:33.026570+00:00) notificationworker stdout | 2022-11-28 08:17:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:17:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:33 UTC)" (scheduled at 2022-11-28 08:17:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:17:33,414 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:17:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:07 UTC)" (scheduled at 2022-11-28 08:17:37.716126+00:00) securityworker stdout | 2022-11-28 08:17:37,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:17:37,797 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:17:37,798 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:17:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:17:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:17:39,497 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:17:39,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:39,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:17:39,546 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:17:39,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 08:17:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:52 UTC)" (scheduled at 2022-11-28 08:17:42.901291+00:00) notificationworker stdout | 2022-11-28 08:17:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:17:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:17:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:15 UTC)" (scheduled at 2022-11-28 08:17:45.911636+00:00) securityworker stdout | 2022-11-28 08:17:45,955 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:17:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:17 UTC)" (scheduled at 2022-11-28 08:17:47.016425+00:00) gcworker stdout | 2022-11-28 08:17:47,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:17 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:17:47,104 [243] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:08:17:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:08:17:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.551 635 0.551) nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:08:17:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" (0.570 635 0.570) gunicorn-registry stdout | 2022-11-28 08:17:47,124 [241] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:08:17:47 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apull%2Cpush&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "containers/5.21.1 (github.com/containers/image)" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:17:47 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" (0.158 1652 0.158) gunicorn-registry stdout | 2022-11-28 08:17:47,342 [243] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:08:17:47 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:40cf597a9181e86497f4121c604f9f0ab208950a98ca21db883f26b0a548a2eb HTTP/1.1" 404 0 "-" "containers/5.21.1 (github.com/containers/image)" gunicorn-registry stdout | 2022-11-28 08:17:47,496 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 08:17:47,498 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:08:17:47 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:08:17:47 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "containers/5.21.1 (github.com/containers/image)" (0.086 1631 0.086) exportactionlogsworker stdout | 2022-11-28 08:17:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:50 UTC)" (scheduled at 2022-11-28 08:17:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:17:50,179 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:17:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:51 UTC)" (scheduled at 2022-11-28 08:17:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:17:51,801 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:17:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:02 UTC)" (scheduled at 2022-11-28 08:17:52.901291+00:00) notificationworker stdout | 2022-11-28 08:17:52,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:17:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:23 UTC)" (scheduled at 2022-11-28 08:17:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:17:53,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:17:54,504 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:17:54,512 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:54,515 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:17:54,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:17:54,521 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:17:54,525 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:17:54,677 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.203 118 0.203) gunicorn-web stdout | 2022-11-28 08:17:54,678 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.205 118 0.205) securityscanningnotificationworker stdout | 2022-11-28 08:17:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:56 UTC)" (scheduled at 2022-11-28 08:17:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:17:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:17:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:57 UTC)" (scheduled at 2022-11-28 08:17:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:17:57,659 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:18:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:18:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:12 UTC)" (scheduled at 2022-11-28 08:18:02.901291+00:00) notificationworker stdout | 2022-11-28 08:18:02,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:18:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:03 UTC)" (scheduled at 2022-11-28 08:18:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:18:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:18:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:06 UTC)" (scheduled at 2022-11-28 08:18:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:18:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:18:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:37 UTC)" (scheduled at 2022-11-28 08:18:07.716126+00:00) securityworker stdout | 2022-11-28 08:18:07,743 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:18:07,821 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:18:07,822 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:18:09,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:18:09,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:18:09,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:18:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:18:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:18:09,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 08:18:09,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:18:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:22 UTC)" (scheduled at 2022-11-28 08:18:12.901291+00:00) notificationworker stdout | 2022-11-28 08:18:12,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:18:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:15 UTC)" (scheduled at 2022-11-28 08:18:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:18:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:18:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:45 UTC)" (scheduled at 2022-11-28 08:18:15.911636+00:00) securityworker stdout | 2022-11-28 08:18:16,046 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:18:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:47 UTC)" (scheduled at 2022-11-28 08:18:17.016425+00:00) gcworker stdout | 2022-11-28 08:18:17,094 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:18:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:32 UTC)" (scheduled at 2022-11-28 08:18:22.901291+00:00) notificationworker stdout | 2022-11-28 08:18:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:18:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:53 UTC)" (scheduled at 2022-11-28 08:18:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:18:23,140 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:18:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:18:24,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:18:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:18:24,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:24,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:18:24,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:18:24,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) gunicorn-web stdout | 2022-11-28 08:18:24,624 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.303 118 0.303) gunicorn-web stdout | 2022-11-28 08:18:24,776 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:18:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:42 UTC)" (scheduled at 2022-11-28 08:18:32.901291+00:00) notificationworker stdout | 2022-11-28 08:18:32,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:18:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:33 UTC)" (scheduled at 2022-11-28 08:18:33.026570+00:00) notificationworker stdout | 2022-11-28 08:18:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:18:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:33 UTC)" (scheduled at 2022-11-28 08:18:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:18:33,377 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:18:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:07 UTC)" (scheduled at 2022-11-28 08:18:37.716126+00:00) securityworker stdout | 2022-11-28 08:18:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:18:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:18:37,771 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:18:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:23:38 UTC)" (scheduled at 2022-11-28 08:18:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:18:38,501 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:23:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:18:39,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:18:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:18:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:39,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:18:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 08:18:39,538 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:18:39,540 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:18:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:52 UTC)" (scheduled at 2022-11-28 08:18:42.901291+00:00) notificationworker stdout | 2022-11-28 08:18:42,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:18:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:18:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:15 UTC)" (scheduled at 2022-11-28 08:18:45.911636+00:00) securityworker stdout | 2022-11-28 08:18:45,981 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:18:47,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:17 UTC)" (scheduled at 2022-11-28 08:18:47.016425+00:00) gcworker stdout | 2022-11-28 08:18:47,088 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:18:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:23:49 UTC)" (scheduled at 2022-11-28 08:18:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:18:49,453 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:23:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:18:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:50 UTC)" (scheduled at 2022-11-28 08:18:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:18:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:18:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:51 UTC)" (scheduled at 2022-11-28 08:18:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:18:51,785 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:18:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:02 UTC)" (scheduled at 2022-11-28 08:18:52.901291+00:00) notificationworker stdout | 2022-11-28 08:18:52,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:18:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:23 UTC)" (scheduled at 2022-11-28 08:18:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:18:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:18:54,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:18:54,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:18:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:18:54,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:18:54,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:18:54,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:18:54,555 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) securityscanningnotificationworker stdout | 2022-11-28 08:18:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:56 UTC)" (scheduled at 2022-11-28 08:18:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:18:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:18:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:57 UTC)" (scheduled at 2022-11-28 08:18:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:18:57,569 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:19:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:19:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:12 UTC)" (scheduled at 2022-11-28 08:19:02.901291+00:00) notificationworker stdout | 2022-11-28 08:19:02,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:19:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:03 UTC)" (scheduled at 2022-11-28 08:19:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:19:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:19:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:06 UTC)" (scheduled at 2022-11-28 08:19:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:19:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:19:07,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:37 UTC)" (scheduled at 2022-11-28 08:19:07.716126+00:00) securityworker stdout | 2022-11-28 08:19:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:19:07,820 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:19:07,821 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:19:09,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:19:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:19:09,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:19:09,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:19:09,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:19:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:19:09,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:19:09,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 08:19:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:22 UTC)" (scheduled at 2022-11-28 08:19:12.901291+00:00) notificationworker stdout | 2022-11-28 08:19:12,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:19:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:15 UTC)" (scheduled at 2022-11-28 08:19:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:19:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:19:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:45 UTC)" (scheduled at 2022-11-28 08:19:15.911636+00:00) securityworker stdout | 2022-11-28 08:19:15,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:19:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:47 UTC)" (scheduled at 2022-11-28 08:19:17.016425+00:00) gcworker stdout | 2022-11-28 08:19:17,087 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:19:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:32 UTC)" (scheduled at 2022-11-28 08:19:22.901291+00:00) notificationworker stdout | 2022-11-28 08:19:22,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:19:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:53 UTC)" (scheduled at 2022-11-28 08:19:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:19:23,164 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:19:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:19:24,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:19:24,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 08:19:24,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:19:24,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:19:24,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:19:24,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) gunicorn-web stdout | 2022-11-28 08:19:24,577 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:19:24,585 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:19:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:42 UTC)" (scheduled at 2022-11-28 08:19:32.901291+00:00) notificationworker stdout | 2022-11-28 08:19:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:19:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:33 UTC)" (scheduled at 2022-11-28 08:19:33.026570+00:00) notificationworker stdout | 2022-11-28 08:19:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:19:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:33 UTC)" (scheduled at 2022-11-28 08:19:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:19:33,375 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:19:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:07 UTC)" (scheduled at 2022-11-28 08:19:37.716126+00:00) securityworker stdout | 2022-11-28 08:19:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:19:37,795 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:19:37,795 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:19:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:24:38 UTC)" (scheduled at 2022-11-28 08:19:38.024004+00:00) notificationworker stdout | 2022-11-28 08:19:38,108 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:24:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:19:39,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:19:39,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:19:39,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:19:39,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:19:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:19:39,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:19:39,541 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:19:39,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:19:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:52 UTC)" (scheduled at 2022-11-28 08:19:42.901291+00:00) notificationworker stdout | 2022-11-28 08:19:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:19:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:19:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:15 UTC)" (scheduled at 2022-11-28 08:19:45.911636+00:00) securityworker stdout | 2022-11-28 08:19:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:19:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:17 UTC)" (scheduled at 2022-11-28 08:19:47.016425+00:00) gcworker stdout | 2022-11-28 08:19:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:19:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:50 UTC)" (scheduled at 2022-11-28 08:19:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:19:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:19:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:51 UTC)" (scheduled at 2022-11-28 08:19:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:19:51,837 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:19:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:02 UTC)" (scheduled at 2022-11-28 08:19:52.901291+00:00) notificationworker stdout | 2022-11-28 08:19:52,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:19:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:23 UTC)" (scheduled at 2022-11-28 08:19:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:19:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:19:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:19:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:19:54,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:19:54,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:19:54,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:19:54,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:19:54,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 08:19:54,583 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) securityscanningnotificationworker stdout | 2022-11-28 08:19:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:56 UTC)" (scheduled at 2022-11-28 08:19:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:19:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:19:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:57 UTC)" (scheduled at 2022-11-28 08:19:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:19:57,631 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:20:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:20:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:12 UTC)" (scheduled at 2022-11-28 08:20:02.901291+00:00) notificationworker stdout | 2022-11-28 08:20:02,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:20:03,410 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:03 UTC)" (scheduled at 2022-11-28 08:20:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:20:03,410 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:20:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:06 UTC)" (scheduled at 2022-11-28 08:20:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:20:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:20:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:37 UTC)" (scheduled at 2022-11-28 08:20:07.716126+00:00) securityworker stdout | 2022-11-28 08:20:07,831 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:20:08,001 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:20:08,001 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:20:09,482 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:20:09,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:20:09,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:20:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 08:20:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:20:09,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 08:20:09,575 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:20:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:22 UTC)" (scheduled at 2022-11-28 08:20:12.901291+00:00) notificationworker stdout | 2022-11-28 08:20:12,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:20:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:15 UTC)" (scheduled at 2022-11-28 08:20:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:20:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:20:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:45 UTC)" (scheduled at 2022-11-28 08:20:15.911636+00:00) securityworker stdout | 2022-11-28 08:20:16,013 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:20:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:47 UTC)" (scheduled at 2022-11-28 08:20:17.016425+00:00) gcworker stdout | 2022-11-28 08:20:17,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:20:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:32 UTC)" (scheduled at 2022-11-28 08:20:22.901291+00:00) notificationworker stdout | 2022-11-28 08:20:22,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:20:23,119 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:53 UTC)" (scheduled at 2022-11-28 08:20:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:20:23,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:20:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:20:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:20:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 08:20:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:20:24,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:20:24,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) gunicorn-web stdout | 2022-11-28 08:20:24,536 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:20:24,537 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:20:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:42 UTC)" (scheduled at 2022-11-28 08:20:32.901291+00:00) notificationworker stdout | 2022-11-28 08:20:32,996 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:20:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:33 UTC)" (scheduled at 2022-11-28 08:20:33.026570+00:00) notificationworker stdout | 2022-11-28 08:20:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:20:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:33 UTC)" (scheduled at 2022-11-28 08:20:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:20:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:20:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:07 UTC)" (scheduled at 2022-11-28 08:20:37.716126+00:00) securityworker stdout | 2022-11-28 08:20:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:20:37,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:20:37,782 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:20:39,502 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:20:39,502 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:39,522 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:20:39,526 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:20:39,534 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:39,538 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:20:39,590 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 08:20:39,593 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:20:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:25:41 UTC)" (scheduled at 2022-11-28 08:20:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:20:41,237 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:25:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:20:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:52 UTC)" (scheduled at 2022-11-28 08:20:42.901291+00:00) notificationworker stdout | 2022-11-28 08:20:42,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:20:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:20:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:15 UTC)" (scheduled at 2022-11-28 08:20:45.911636+00:00) securityworker stdout | 2022-11-28 08:20:45,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:20:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:17 UTC)" (scheduled at 2022-11-28 08:20:47.016425+00:00) gcworker stdout | 2022-11-28 08:20:47,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:20:48,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:25:48 UTC)" (scheduled at 2022-11-28 08:20:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:20:48,090 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:25:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:20:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:50 UTC)" (scheduled at 2022-11-28 08:20:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:20:50,180 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:20:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:51 UTC)" (scheduled at 2022-11-28 08:20:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:20:51,764 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:20:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:02 UTC)" (scheduled at 2022-11-28 08:20:52.901291+00:00) notificationworker stdout | 2022-11-28 08:20:52,990 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:20:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:23 UTC)" (scheduled at 2022-11-28 08:20:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:20:53,196 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:20:54,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:20:54,494 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:20:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:54,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:20:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:20:54,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:20:54,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:20:54,579 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) securityscanningnotificationworker stdout | 2022-11-28 08:20:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:56 UTC)" (scheduled at 2022-11-28 08:20:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:20:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:20:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:57 UTC)" (scheduled at 2022-11-28 08:20:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:20:57,590 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:21:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:21:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:12 UTC)" (scheduled at 2022-11-28 08:21:02.901291+00:00) notificationworker stdout | 2022-11-28 08:21:02,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:21:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:03 UTC)" (scheduled at 2022-11-28 08:21:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:21:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:21:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:06 UTC)" (scheduled at 2022-11-28 08:21:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:21:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:21:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:37 UTC)" (scheduled at 2022-11-28 08:21:07.716126+00:00) securityworker stdout | 2022-11-28 08:21:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:21:07,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:21:07,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:21:09,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:21:09,485 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 08:21:09,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 08:21:09,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:21:09,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:09,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:21:09,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 08:21:09,584 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:21:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:22 UTC)" (scheduled at 2022-11-28 08:21:12.901291+00:00) notificationworker stdout | 2022-11-28 08:21:13,026 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:21:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:15 UTC)" (scheduled at 2022-11-28 08:21:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:21:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:21:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:45 UTC)" (scheduled at 2022-11-28 08:21:15.911636+00:00) securityworker stdout | 2022-11-28 08:21:15,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:21:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:47 UTC)" (scheduled at 2022-11-28 08:21:17.016425+00:00) gcworker stdout | 2022-11-28 08:21:17,107 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:21:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:32 UTC)" (scheduled at 2022-11-28 08:21:22.901291+00:00) notificationworker stdout | 2022-11-28 08:21:22,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:21:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:53 UTC)" (scheduled at 2022-11-28 08:21:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:21:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:21:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:21:24,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:21:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:21:24,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:21:24,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:21:24,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:21:24,622 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.149 118 0.149) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.198 118 0.198) gunicorn-web stdout | 2022-11-28 08:21:24,670 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:21:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:42 UTC)" (scheduled at 2022-11-28 08:21:32.901291+00:00) notificationworker stdout | 2022-11-28 08:21:32,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:21:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:33 UTC)" (scheduled at 2022-11-28 08:21:33.026570+00:00) notificationworker stdout | 2022-11-28 08:21:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:21:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:33 UTC)" (scheduled at 2022-11-28 08:21:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:21:33,406 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:21:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:07 UTC)" (scheduled at 2022-11-28 08:21:37.716126+00:00) securityworker stdout | 2022-11-28 08:21:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:21:37,811 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:21:37,812 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:21:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:21:39,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:21:39,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:39,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:21:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) gunicorn-web stdout | 2022-11-28 08:21:39,622 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:21:39,624 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) blobuploadcleanupworker stdout | 2022-11-28 08:21:40,533 [58] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 09:21:40 UTC)" (scheduled at 2022-11-28 08:21:40.531944+00:00) blobuploadcleanupworker stdout | 2022-11-28 08:21:40,563 [58] [INFO] [redis_lock.acquire] Got lock for 'lock:BLOB_CLEANUP'. blobuploadcleanupworker stdout | 2022-11-28 08:21:40,632 [58] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 09:21:40 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:21:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:52 UTC)" (scheduled at 2022-11-28 08:21:42.901291+00:00) notificationworker stdout | 2022-11-28 08:21:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:21:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:21:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:15 UTC)" (scheduled at 2022-11-28 08:21:45.911636+00:00) securityworker stdout | 2022-11-28 08:21:46,034 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:21:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:17 UTC)" (scheduled at 2022-11-28 08:21:47.016425+00:00) gcworker stdout | 2022-11-28 08:21:47,099 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:21:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:50 UTC)" (scheduled at 2022-11-28 08:21:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:21:50,180 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:21:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:51 UTC)" (scheduled at 2022-11-28 08:21:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:21:51,784 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:21:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:02 UTC)" (scheduled at 2022-11-28 08:21:52.901291+00:00) notificationworker stdout | 2022-11-28 08:21:52,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:21:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:23 UTC)" (scheduled at 2022-11-28 08:21:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:21:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:21:54,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:21:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:21:54,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:54,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:21:54,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:21:54,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:21:54,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 08:21:54,585 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:21:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:56 UTC)" (scheduled at 2022-11-28 08:21:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:21:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:21:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:57 UTC)" (scheduled at 2022-11-28 08:21:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:21:57,543 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:22:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:22:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:12 UTC)" (scheduled at 2022-11-28 08:22:02.901291+00:00) notificationworker stdout | 2022-11-28 08:22:02,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:22:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:03 UTC)" (scheduled at 2022-11-28 08:22:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:22:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:22:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:06 UTC)" (scheduled at 2022-11-28 08:22:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:22:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:22:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:37 UTC)" (scheduled at 2022-11-28 08:22:07.716126+00:00) securityworker stdout | 2022-11-28 08:22:07,747 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:22:07,810 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:22:07,810 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:22:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:22:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:22:09,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:09,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:22:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:22:09,548 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:22:09,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 08:22:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:22 UTC)" (scheduled at 2022-11-28 08:22:12.901291+00:00) notificationworker stdout | 2022-11-28 08:22:12,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:22:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:15 UTC)" (scheduled at 2022-11-28 08:22:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:22:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:22:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:45 UTC)" (scheduled at 2022-11-28 08:22:15.911636+00:00) securityworker stdout | 2022-11-28 08:22:15,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:22:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:47 UTC)" (scheduled at 2022-11-28 08:22:17.016425+00:00) gcworker stdout | 2022-11-28 08:22:17,157 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:22:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:32 UTC)" (scheduled at 2022-11-28 08:22:22.901291+00:00) notificationworker stdout | 2022-11-28 08:22:22,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:22:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:53 UTC)" (scheduled at 2022-11-28 08:22:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:22:23,139 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:22:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:22:24,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:22:24,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:24,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:24,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:24,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:22:24,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 08:22:24,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 08:22:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:42 UTC)" (scheduled at 2022-11-28 08:22:32.901291+00:00) notificationworker stdout | 2022-11-28 08:22:32,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:22:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:33 UTC)" (scheduled at 2022-11-28 08:22:33.026570+00:00) notificationworker stdout | 2022-11-28 08:22:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:22:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:33 UTC)" (scheduled at 2022-11-28 08:22:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:22:33,375 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:22:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:07 UTC)" (scheduled at 2022-11-28 08:22:37.716126+00:00) securityworker stdout | 2022-11-28 08:22:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:22:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:22:37,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:22:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:22:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:39,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:39,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:39,496 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:22:39,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.053 118 0.053) gunicorn-web stdout | 2022-11-28 08:22:39,525 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) gunicorn-web stdout | 2022-11-28 08:22:39,528 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:22:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:52 UTC)" (scheduled at 2022-11-28 08:22:42.901291+00:00) notificationworker stdout | 2022-11-28 08:22:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:22:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:22:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:15 UTC)" (scheduled at 2022-11-28 08:22:45.911636+00:00) securityworker stdout | 2022-11-28 08:22:46,007 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:22:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:17 UTC)" (scheduled at 2022-11-28 08:22:47.016425+00:00) gcworker stdout | 2022-11-28 08:22:47,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:22:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:50 UTC)" (scheduled at 2022-11-28 08:22:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:22:50,186 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:22:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:51 UTC)" (scheduled at 2022-11-28 08:22:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:22:51,784 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:22:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:02 UTC)" (scheduled at 2022-11-28 08:22:52.901291+00:00) notificationworker stdout | 2022-11-28 08:22:52,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:22:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:23 UTC)" (scheduled at 2022-11-28 08:22:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:22:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:22:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:22:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:22:54,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:22:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:22:54,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:22:54,551 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:22:54,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:22:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:56 UTC)" (scheduled at 2022-11-28 08:22:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:22:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:22:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:57 UTC)" (scheduled at 2022-11-28 08:22:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:22:57,571 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:23:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:23:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:12 UTC)" (scheduled at 2022-11-28 08:23:02.901291+00:00) notificationworker stdout | 2022-11-28 08:23:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:23:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:03 UTC)" (scheduled at 2022-11-28 08:23:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:23:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:23:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:06 UTC)" (scheduled at 2022-11-28 08:23:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:23:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:23:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:37 UTC)" (scheduled at 2022-11-28 08:23:07.716126+00:00) securityworker stdout | 2022-11-28 08:23:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:23:07,791 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:23:07,792 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:23:09,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:23:09,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:09,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:23:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:23:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 08:23:09,536 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:23:09,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:23:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:22 UTC)" (scheduled at 2022-11-28 08:23:12.901291+00:00) notificationworker stdout | 2022-11-28 08:23:12,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:23:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:15 UTC)" (scheduled at 2022-11-28 08:23:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:23:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:23:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:45 UTC)" (scheduled at 2022-11-28 08:23:15.911636+00:00) securityworker stdout | 2022-11-28 08:23:15,984 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:23:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:47 UTC)" (scheduled at 2022-11-28 08:23:17.016425+00:00) gcworker stdout | 2022-11-28 08:23:17,127 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:23:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:32 UTC)" (scheduled at 2022-11-28 08:23:22.901291+00:00) notificationworker stdout | 2022-11-28 08:23:22,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:23:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:53 UTC)" (scheduled at 2022-11-28 08:23:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:23:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:23:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:23:24,499 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 08:23:24,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:23:24,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:23:24,504 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:24,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:23:24,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 08:23:24,593 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.121 118 0.121) gunicorn-web stdout | 2022-11-28 08:23:24,601 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:23:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:42 UTC)" (scheduled at 2022-11-28 08:23:32.901291+00:00) notificationworker stdout | 2022-11-28 08:23:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:23:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:33 UTC)" (scheduled at 2022-11-28 08:23:33.026570+00:00) notificationworker stdout | 2022-11-28 08:23:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:23:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:33 UTC)" (scheduled at 2022-11-28 08:23:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:23:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:23:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:07 UTC)" (scheduled at 2022-11-28 08:23:37.716126+00:00) securityworker stdout | 2022-11-28 08:23:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:23:37,813 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:23:37,813 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:23:38,421 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:28:38 UTC)" (scheduled at 2022-11-28 08:23:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:23:38,480 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:28:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:23:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:23:39,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:23:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:23:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.097) gunicorn-web stdout | 2022-11-28 08:23:39,574 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.110) gunicorn-web stdout | 2022-11-28 08:23:39,585 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:23:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:52 UTC)" (scheduled at 2022-11-28 08:23:42.901291+00:00) notificationworker stdout | 2022-11-28 08:23:42,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:23:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:23:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:15 UTC)" (scheduled at 2022-11-28 08:23:45.911636+00:00) securityworker stdout | 2022-11-28 08:23:45,989 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:23:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:17 UTC)" (scheduled at 2022-11-28 08:23:47.016425+00:00) gcworker stdout | 2022-11-28 08:23:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:23:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:28:49 UTC)" (scheduled at 2022-11-28 08:23:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:23:49,455 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:28:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:23:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:50 UTC)" (scheduled at 2022-11-28 08:23:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:23:50,165 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:23:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:51 UTC)" (scheduled at 2022-11-28 08:23:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:23:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:23:52,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:02 UTC)" (scheduled at 2022-11-28 08:23:52.901291+00:00) notificationworker stdout | 2022-11-28 08:23:52,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:23:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:23 UTC)" (scheduled at 2022-11-28 08:23:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:23:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:23:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 08:23:54,495 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:23:54,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:23:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:23:54,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:23:54,560 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:23:54,562 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:23:54,606 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) securityscanningnotificationworker stdout | 2022-11-28 08:23:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:56 UTC)" (scheduled at 2022-11-28 08:23:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:23:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:23:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:57 UTC)" (scheduled at 2022-11-28 08:23:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:23:57,593 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:24:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:24:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:12 UTC)" (scheduled at 2022-11-28 08:24:02.901291+00:00) notificationworker stdout | 2022-11-28 08:24:02,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:24:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:03 UTC)" (scheduled at 2022-11-28 08:24:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:24:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:24:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:06 UTC)" (scheduled at 2022-11-28 08:24:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:24:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:24:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:37 UTC)" (scheduled at 2022-11-28 08:24:07.716126+00:00) securityworker stdout | 2022-11-28 08:24:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:24:07,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:24:07,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:24:09,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:24:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:24:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:09,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:24:09,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:24:09,546 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:24:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:22 UTC)" (scheduled at 2022-11-28 08:24:12.901291+00:00) notificationworker stdout | 2022-11-28 08:24:12,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:24:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:15 UTC)" (scheduled at 2022-11-28 08:24:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:24:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:24:15,917 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:45 UTC)" (scheduled at 2022-11-28 08:24:15.911636+00:00) securityworker stdout | 2022-11-28 08:24:15,973 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:24:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:47 UTC)" (scheduled at 2022-11-28 08:24:17.016425+00:00) gcworker stdout | 2022-11-28 08:24:17,052 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:24:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:32 UTC)" (scheduled at 2022-11-28 08:24:22.901291+00:00) notificationworker stdout | 2022-11-28 08:24:23,016 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:24:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:53 UTC)" (scheduled at 2022-11-28 08:24:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:24:23,164 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:24:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:24:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:24:24,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:24:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:24,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:24:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:24,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:24:24,581 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:24:24,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) notificationworker stdout | 2022-11-28 08:24:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:42 UTC)" (scheduled at 2022-11-28 08:24:32.901291+00:00) notificationworker stdout | 2022-11-28 08:24:32,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:24:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:33 UTC)" (scheduled at 2022-11-28 08:24:33.026570+00:00) notificationworker stdout | 2022-11-28 08:24:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:24:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:33 UTC)" (scheduled at 2022-11-28 08:24:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:24:33,372 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:24:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:07 UTC)" (scheduled at 2022-11-28 08:24:37.716126+00:00) securityworker stdout | 2022-11-28 08:24:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:24:37,791 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:24:37,791 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:24:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:29:38 UTC)" (scheduled at 2022-11-28 08:24:38.024004+00:00) notificationworker stdout | 2022-11-28 08:24:38,105 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:29:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:24:39,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:24:39,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:39,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:39,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:39,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:24:39,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 08:24:39,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:24:39,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 08:24:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:52 UTC)" (scheduled at 2022-11-28 08:24:42.901291+00:00) notificationworker stdout | 2022-11-28 08:24:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:24:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:24:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:15 UTC)" (scheduled at 2022-11-28 08:24:45.911636+00:00) securityworker stdout | 2022-11-28 08:24:45,980 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:24:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:17 UTC)" (scheduled at 2022-11-28 08:24:47.016425+00:00) gcworker stdout | 2022-11-28 08:24:47,085 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:24:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:50 UTC)" (scheduled at 2022-11-28 08:24:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:24:50,186 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:24:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:51 UTC)" (scheduled at 2022-11-28 08:24:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:24:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:24:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:02 UTC)" (scheduled at 2022-11-28 08:24:52.901291+00:00) notificationworker stdout | 2022-11-28 08:24:52,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:24:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:23 UTC)" (scheduled at 2022-11-28 08:24:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:24:53,168 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:24:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:24:54,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:54,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:54,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:24:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:24:54,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:24:54,571 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) gunicorn-web stdout | 2022-11-28 08:24:54,575 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:24:56,166 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:56 UTC)" (scheduled at 2022-11-28 08:24:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:24:56,167 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:24:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:57 UTC)" (scheduled at 2022-11-28 08:24:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:24:57,573 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:25:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:25:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:12 UTC)" (scheduled at 2022-11-28 08:25:02.901291+00:00) notificationworker stdout | 2022-11-28 08:25:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:25:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:03 UTC)" (scheduled at 2022-11-28 08:25:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:25:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:25:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:06 UTC)" (scheduled at 2022-11-28 08:25:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:25:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:25:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:37 UTC)" (scheduled at 2022-11-28 08:25:07.716126+00:00) securityworker stdout | 2022-11-28 08:25:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:25:07,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:25:07,782 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:25:09,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:25:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:09,492 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:09,494 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:25:09,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:09,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 08:25:09,536 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:25:09,536 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) notificationworker stdout | 2022-11-28 08:25:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:22 UTC)" (scheduled at 2022-11-28 08:25:12.901291+00:00) notificationworker stdout | 2022-11-28 08:25:12,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:25:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:15 UTC)" (scheduled at 2022-11-28 08:25:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:25:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:25:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:45 UTC)" (scheduled at 2022-11-28 08:25:15.911636+00:00) securityworker stdout | 2022-11-28 08:25:16,062 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:25:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:47 UTC)" (scheduled at 2022-11-28 08:25:17.016425+00:00) gcworker stdout | 2022-11-28 08:25:17,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:25:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:32 UTC)" (scheduled at 2022-11-28 08:25:22.901291+00:00) notificationworker stdout | 2022-11-28 08:25:22,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:25:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:53 UTC)" (scheduled at 2022-11-28 08:25:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:25:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:25:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:25:24,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:25:24,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:24,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:24,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:25:24,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:24,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:25:24,549 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:25:24,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) notificationworker stdout | 2022-11-28 08:25:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:42 UTC)" (scheduled at 2022-11-28 08:25:32.901291+00:00) notificationworker stdout | 2022-11-28 08:25:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:25:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:33 UTC)" (scheduled at 2022-11-28 08:25:33.026570+00:00) notificationworker stdout | 2022-11-28 08:25:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:25:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:33 UTC)" (scheduled at 2022-11-28 08:25:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:25:33,370 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:25:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:07 UTC)" (scheduled at 2022-11-28 08:25:37.716126+00:00) securityworker stdout | 2022-11-28 08:25:37,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:25:37,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:25:37,783 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:25:39,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:25:39,498 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:25:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:39,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:25:39,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:39,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:25:39,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 08:25:39,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:25:41,166 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:30:41 UTC)" (scheduled at 2022-11-28 08:25:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:25:41,225 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:30:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:25:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:52 UTC)" (scheduled at 2022-11-28 08:25:42.901291+00:00) notificationworker stdout | 2022-11-28 08:25:42,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:25:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:25:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:15 UTC)" (scheduled at 2022-11-28 08:25:45.911636+00:00) securityworker stdout | 2022-11-28 08:25:45,989 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:25:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:17 UTC)" (scheduled at 2022-11-28 08:25:47.016425+00:00) gcworker stdout | 2022-11-28 08:25:47,094 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:25:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:30:48 UTC)" (scheduled at 2022-11-28 08:25:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:25:48,124 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:30:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:25:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:50 UTC)" (scheduled at 2022-11-28 08:25:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:25:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:25:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:51 UTC)" (scheduled at 2022-11-28 08:25:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:25:51,765 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:25:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:02 UTC)" (scheduled at 2022-11-28 08:25:52.901291+00:00) notificationworker stdout | 2022-11-28 08:25:52,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:25:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:23 UTC)" (scheduled at 2022-11-28 08:25:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:25:53,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:25:54,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.019) gunicorn-registry stdout | 2022-11-28 08:25:54,509 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:25:54,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:25:54,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:25:54,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 08:25:54,583 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:25:56,168 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:56 UTC)" (scheduled at 2022-11-28 08:25:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:25:56,168 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:25:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:57 UTC)" (scheduled at 2022-11-28 08:25:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:25:57,543 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:26:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:26:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:12 UTC)" (scheduled at 2022-11-28 08:26:02.901291+00:00) notificationworker stdout | 2022-11-28 08:26:02,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:26:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:03 UTC)" (scheduled at 2022-11-28 08:26:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:26:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:26:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:06 UTC)" (scheduled at 2022-11-28 08:26:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:26:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:26:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:37 UTC)" (scheduled at 2022-11-28 08:26:07.716126+00:00) securityworker stdout | 2022-11-28 08:26:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:26:07,778 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:26:07,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:26:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:26:09,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:26:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:26:09,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:26:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:26:09,592 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.126) gunicorn-web stdout | 2022-11-28 08:26:09,599 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:26:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:22 UTC)" (scheduled at 2022-11-28 08:26:12.901291+00:00) notificationworker stdout | 2022-11-28 08:26:12,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:26:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:15 UTC)" (scheduled at 2022-11-28 08:26:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:26:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:26:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:45 UTC)" (scheduled at 2022-11-28 08:26:15.911636+00:00) securityworker stdout | 2022-11-28 08:26:15,996 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:26:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:47 UTC)" (scheduled at 2022-11-28 08:26:17.016425+00:00) gcworker stdout | 2022-11-28 08:26:17,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:26:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:32 UTC)" (scheduled at 2022-11-28 08:26:22.901291+00:00) notificationworker stdout | 2022-11-28 08:26:22,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:26:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:53 UTC)" (scheduled at 2022-11-28 08:26:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:26:23,173 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:26:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:26:24,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:26:24,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:26:24,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:24,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:26:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:26:24,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 08:26:24,555 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:26:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:42 UTC)" (scheduled at 2022-11-28 08:26:32.901291+00:00) notificationworker stdout | 2022-11-28 08:26:32,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:26:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:33 UTC)" (scheduled at 2022-11-28 08:26:33.026570+00:00) notificationworker stdout | 2022-11-28 08:26:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:26:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:33 UTC)" (scheduled at 2022-11-28 08:26:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:26:33,363 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:26:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:07 UTC)" (scheduled at 2022-11-28 08:26:37.716126+00:00) securityworker stdout | 2022-11-28 08:26:37,741 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:26:37,791 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:26:37,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:26:39,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:26:39,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:26:39,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:39,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:26:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:26:39,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 08:26:39,559 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:26:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:52 UTC)" (scheduled at 2022-11-28 08:26:42.901291+00:00) notificationworker stdout | 2022-11-28 08:26:42,989 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:26:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:26:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:15 UTC)" (scheduled at 2022-11-28 08:26:45.911636+00:00) securityworker stdout | 2022-11-28 08:26:46,046 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:26:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:17 UTC)" (scheduled at 2022-11-28 08:26:47.016425+00:00) gcworker stdout | 2022-11-28 08:26:47,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:26:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:50 UTC)" (scheduled at 2022-11-28 08:26:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:26:50,198 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:26:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:51 UTC)" (scheduled at 2022-11-28 08:26:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:26:51,802 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:26:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:02 UTC)" (scheduled at 2022-11-28 08:26:52.901291+00:00) notificationworker stdout | 2022-11-28 08:26:52,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:26:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:23 UTC)" (scheduled at 2022-11-28 08:26:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:26:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:26:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:26:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:26:54,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:54,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:26:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:26:54,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) gunicorn-web stdout | 2022-11-28 08:26:54,619 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.150) gunicorn-web stdout | 2022-11-28 08:26:54,626 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:26:56,165 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:56 UTC)" (scheduled at 2022-11-28 08:26:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:26:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:26:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:57 UTC)" (scheduled at 2022-11-28 08:26:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:26:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:27:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:27:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:12 UTC)" (scheduled at 2022-11-28 08:27:02.901291+00:00) notificationworker stdout | 2022-11-28 08:27:02,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:27:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:03 UTC)" (scheduled at 2022-11-28 08:27:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:27:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:27:06,426 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:06 UTC)" (scheduled at 2022-11-28 08:27:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:27:06,427 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:27:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:37 UTC)" (scheduled at 2022-11-28 08:27:07.716126+00:00) securityworker stdout | 2022-11-28 08:27:07,797 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:27:07,882 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:27:07,883 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:27:09,492 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:27:09,498 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:09,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:27:09,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:27:09,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:09,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:27:09,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 08:27:09,598 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:27:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:22 UTC)" (scheduled at 2022-11-28 08:27:12.901291+00:00) notificationworker stdout | 2022-11-28 08:27:12,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:27:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:15 UTC)" (scheduled at 2022-11-28 08:27:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:27:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:27:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:45 UTC)" (scheduled at 2022-11-28 08:27:15.911636+00:00) securityworker stdout | 2022-11-28 08:27:15,993 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:27:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:47 UTC)" (scheduled at 2022-11-28 08:27:17.016425+00:00) gcworker stdout | 2022-11-28 08:27:17,112 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:27:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:32 UTC)" (scheduled at 2022-11-28 08:27:22.901291+00:00) notificationworker stdout | 2022-11-28 08:27:22,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:27:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:53 UTC)" (scheduled at 2022-11-28 08:27:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:27:23,188 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:27:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:27:24,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:27:24,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:27:24,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:27:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:27:24,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 08:27:24,561 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 08:27:24,576 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:27:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:42 UTC)" (scheduled at 2022-11-28 08:27:32.901291+00:00) notificationworker stdout | 2022-11-28 08:27:33,006 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:27:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:33 UTC)" (scheduled at 2022-11-28 08:27:33.026570+00:00) notificationworker stdout | 2022-11-28 08:27:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:27:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:33 UTC)" (scheduled at 2022-11-28 08:27:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:27:33,377 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:27:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:07 UTC)" (scheduled at 2022-11-28 08:27:37.716126+00:00) securityworker stdout | 2022-11-28 08:27:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:27:37,828 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:27:37,828 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:27:39,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:27:39,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:27:39,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:39,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:27:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:39,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:27:39,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) gunicorn-web stdout | 2022-11-28 08:27:39,583 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:27:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:52 UTC)" (scheduled at 2022-11-28 08:27:42.901291+00:00) notificationworker stdout | 2022-11-28 08:27:42,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:27:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:27:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:15 UTC)" (scheduled at 2022-11-28 08:27:45.911636+00:00) securityworker stdout | 2022-11-28 08:27:46,108 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:27:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:17 UTC)" (scheduled at 2022-11-28 08:27:47.016425+00:00) gcworker stdout | 2022-11-28 08:27:47,079 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:27:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:50 UTC)" (scheduled at 2022-11-28 08:27:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:27:50,171 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:50 UTC)" executed successfully expiredappspecifictokenworker stdout | 2022-11-28 08:27:50,336 [63] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 09:27:50 UTC)" (scheduled at 2022-11-28 08:27:50.334970+00:00) expiredappspecifictokenworker stdout | 2022-11-28 08:27:50,383 [63] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 09:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:27:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:51 UTC)" (scheduled at 2022-11-28 08:27:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:27:51,811 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:27:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:02 UTC)" (scheduled at 2022-11-28 08:27:52.901291+00:00) notificationworker stdout | 2022-11-28 08:27:53,033 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:27:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:23 UTC)" (scheduled at 2022-11-28 08:27:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:27:53,232 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:27:54,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:27:54,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:54,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:27:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:27:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:27:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) gunicorn-web stdout | 2022-11-28 08:27:54,597 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) gunicorn-web stdout | 2022-11-28 08:27:54,623 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:27:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:56 UTC)" (scheduled at 2022-11-28 08:27:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:27:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:27:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:57 UTC)" (scheduled at 2022-11-28 08:27:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:27:57,686 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:28:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:28:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:12 UTC)" (scheduled at 2022-11-28 08:28:02.901291+00:00) notificationworker stdout | 2022-11-28 08:28:02,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:28:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:03 UTC)" (scheduled at 2022-11-28 08:28:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:28:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:28:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:06 UTC)" (scheduled at 2022-11-28 08:28:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:28:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:28:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:37 UTC)" (scheduled at 2022-11-28 08:28:07.716126+00:00) securityworker stdout | 2022-11-28 08:28:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:28:07,819 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:28:07,819 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:28:09,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:28:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:09,491 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:09,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:28:09,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:09,495 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:28:09,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 08:28:09,541 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:28:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:22 UTC)" (scheduled at 2022-11-28 08:28:12.901291+00:00) notificationworker stdout | 2022-11-28 08:28:13,047 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:28:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:15 UTC)" (scheduled at 2022-11-28 08:28:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:28:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:28:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:45 UTC)" (scheduled at 2022-11-28 08:28:15.911636+00:00) securityworker stdout | 2022-11-28 08:28:16,013 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:28:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:47 UTC)" (scheduled at 2022-11-28 08:28:17.016425+00:00) gcworker stdout | 2022-11-28 08:28:17,126 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:28:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:32 UTC)" (scheduled at 2022-11-28 08:28:22.901291+00:00) notificationworker stdout | 2022-11-28 08:28:22,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:28:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:53 UTC)" (scheduled at 2022-11-28 08:28:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:28:23,189 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:28:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:28:24,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:28:24,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:28:24,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:28:24,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.175 118 0.175) gunicorn-web stdout | 2022-11-28 08:28:24,648 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.184 118 0.184) gunicorn-web stdout | 2022-11-28 08:28:24,657 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:28:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:42 UTC)" (scheduled at 2022-11-28 08:28:32.901291+00:00) notificationworker stdout | 2022-11-28 08:28:32,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:28:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:33 UTC)" (scheduled at 2022-11-28 08:28:33.026570+00:00) notificationworker stdout | 2022-11-28 08:28:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:28:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:33 UTC)" (scheduled at 2022-11-28 08:28:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:28:33,396 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:28:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:07 UTC)" (scheduled at 2022-11-28 08:28:37.716126+00:00) securityworker stdout | 2022-11-28 08:28:37,768 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:28:37,869 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:28:37,870 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:28:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:33:38 UTC)" (scheduled at 2022-11-28 08:28:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:28:38,490 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:33:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:28:39,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:28:39,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:39,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:39,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:39,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:28:39,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 08:28:39,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 08:28:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:52 UTC)" (scheduled at 2022-11-28 08:28:42.901291+00:00) notificationworker stdout | 2022-11-28 08:28:42,973 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:28:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:28:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:15 UTC)" (scheduled at 2022-11-28 08:28:45.911636+00:00) securityworker stdout | 2022-11-28 08:28:46,054 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:28:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:17 UTC)" (scheduled at 2022-11-28 08:28:47.016425+00:00) gcworker stdout | 2022-11-28 08:28:47,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:28:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:33:49 UTC)" (scheduled at 2022-11-28 08:28:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:28:49,492 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:33:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:28:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:50 UTC)" (scheduled at 2022-11-28 08:28:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:28:50,190 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:28:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:51 UTC)" (scheduled at 2022-11-28 08:28:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:28:51,899 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:28:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:02 UTC)" (scheduled at 2022-11-28 08:28:52.901291+00:00) notificationworker stdout | 2022-11-28 08:28:52,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:28:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:23 UTC)" (scheduled at 2022-11-28 08:28:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:28:53,209 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:28:54,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:28:54,496 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:28:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:28:54,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:28:54,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:28:54,584 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 08:28:54,591 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:28:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:56 UTC)" (scheduled at 2022-11-28 08:28:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:28:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:28:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:57 UTC)" (scheduled at 2022-11-28 08:28:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:28:57,672 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:29:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:29:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:12 UTC)" (scheduled at 2022-11-28 08:29:02.901291+00:00) notificationworker stdout | 2022-11-28 08:29:02,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:29:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:03 UTC)" (scheduled at 2022-11-28 08:29:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:29:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:29:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:06 UTC)" (scheduled at 2022-11-28 08:29:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:29:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:29:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:37 UTC)" (scheduled at 2022-11-28 08:29:07.716126+00:00) securityworker stdout | 2022-11-28 08:29:07,793 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:29:07,941 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:29:07,941 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:29:09,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:29:09,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:29:09,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:29:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 08:29:09,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:29:09,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) notificationworker stdout | 2022-11-28 08:29:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:22 UTC)" (scheduled at 2022-11-28 08:29:12.901291+00:00) notificationworker stdout | 2022-11-28 08:29:12,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:29:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:15 UTC)" (scheduled at 2022-11-28 08:29:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:29:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:29:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:45 UTC)" (scheduled at 2022-11-28 08:29:15.911636+00:00) securityworker stdout | 2022-11-28 08:29:15,980 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:29:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:47 UTC)" (scheduled at 2022-11-28 08:29:17.016425+00:00) gcworker stdout | 2022-11-28 08:29:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:29:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:32 UTC)" (scheduled at 2022-11-28 08:29:22.901291+00:00) notificationworker stdout | 2022-11-28 08:29:23,041 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:29:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:53 UTC)" (scheduled at 2022-11-28 08:29:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:29:23,205 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:29:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:29:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:29:24,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:29:24,501 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:29:24,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) gunicorn-web stdout | 2022-11-28 08:29:24,612 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.165 118 0.165) gunicorn-web stdout | 2022-11-28 08:29:24,638 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:29:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:42 UTC)" (scheduled at 2022-11-28 08:29:32.901291+00:00) notificationworker stdout | 2022-11-28 08:29:32,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:29:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:33 UTC)" (scheduled at 2022-11-28 08:29:33.026570+00:00) notificationworker stdout | 2022-11-28 08:29:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:29:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:33 UTC)" (scheduled at 2022-11-28 08:29:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:29:33,439 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:29:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:07 UTC)" (scheduled at 2022-11-28 08:29:37.716126+00:00) securityworker stdout | 2022-11-28 08:29:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:29:37,866 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:29:37,868 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:29:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:34:38 UTC)" (scheduled at 2022-11-28 08:29:38.024004+00:00) notificationworker stdout | 2022-11-28 08:29:38,112 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:34:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:29:39,498 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:29:39,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:29:39,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:39,513 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:39,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 08:29:39,519 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.083) gunicorn-web stdout | 2022-11-28 08:29:39,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.101) gunicorn-web stdout | 2022-11-28 08:29:39,580 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:29:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:52 UTC)" (scheduled at 2022-11-28 08:29:42.901291+00:00) notificationworker stdout | 2022-11-28 08:29:42,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:29:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:29:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:15 UTC)" (scheduled at 2022-11-28 08:29:45.911636+00:00) securityworker stdout | 2022-11-28 08:29:45,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:29:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:17 UTC)" (scheduled at 2022-11-28 08:29:47.016425+00:00) gcworker stdout | 2022-11-28 08:29:47,097 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:29:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:50 UTC)" (scheduled at 2022-11-28 08:29:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:29:50,221 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:29:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:51 UTC)" (scheduled at 2022-11-28 08:29:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:29:51,827 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:29:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:02 UTC)" (scheduled at 2022-11-28 08:29:52.901291+00:00) notificationworker stdout | 2022-11-28 08:29:53,023 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:29:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:23 UTC)" (scheduled at 2022-11-28 08:29:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:29:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:29:54,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:29:54,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:29:54,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:29:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:29:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:29:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:29:54,609 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.138) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.158) gunicorn-web stdout | 2022-11-28 08:29:54,630 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:29:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:56 UTC)" (scheduled at 2022-11-28 08:29:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:29:56,166 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:29:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:57 UTC)" (scheduled at 2022-11-28 08:29:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:29:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:30:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:30:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:12 UTC)" (scheduled at 2022-11-28 08:30:02.901291+00:00) notificationworker stdout | 2022-11-28 08:30:03,087 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:30:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:03 UTC)" (scheduled at 2022-11-28 08:30:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:30:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:30:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:06 UTC)" (scheduled at 2022-11-28 08:30:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:30:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:30:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:37 UTC)" (scheduled at 2022-11-28 08:30:07.716126+00:00) securityworker stdout | 2022-11-28 08:30:07,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:30:07,852 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:30:07,853 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:30:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:30:09,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:30:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:30:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:09,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.138) gunicorn-web stdout | 2022-11-28 08:30:09,612 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:30:09,612 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) notificationworker stdout | 2022-11-28 08:30:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:22 UTC)" (scheduled at 2022-11-28 08:30:12.901291+00:00) notificationworker stdout | 2022-11-28 08:30:13,132 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:30:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:15 UTC)" (scheduled at 2022-11-28 08:30:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:30:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:30:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:45 UTC)" (scheduled at 2022-11-28 08:30:15.911636+00:00) securityworker stdout | 2022-11-28 08:30:16,015 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:30:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:47 UTC)" (scheduled at 2022-11-28 08:30:17.016425+00:00) gcworker stdout | 2022-11-28 08:30:17,111 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:30:22,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:32 UTC)" (scheduled at 2022-11-28 08:30:22.901291+00:00) notificationworker stdout | 2022-11-28 08:30:23,070 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:30:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:53 UTC)" (scheduled at 2022-11-28 08:30:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:30:23,230 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:30:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) gunicorn-registry stdout | 2022-11-28 08:30:24,511 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.027 162 0.027) gunicorn-registry stdout | 2022-11-28 08:30:24,515 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:24,527 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:30:24,529 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:30:24,538 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:30:24,548 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.185 118 0.185) gunicorn-web stdout | 2022-11-28 08:30:24,665 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:30:24,667 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.193 118 0.193) notificationworker stdout | 2022-11-28 08:30:32,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:42 UTC)" (scheduled at 2022-11-28 08:30:32.901291+00:00) notificationworker stdout | 2022-11-28 08:30:33,034 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:30:33,034 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:33 UTC)" (scheduled at 2022-11-28 08:30:33.026570+00:00) notificationworker stdout | 2022-11-28 08:30:33,035 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:30:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:33 UTC)" (scheduled at 2022-11-28 08:30:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:30:33,443 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:30:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:07 UTC)" (scheduled at 2022-11-28 08:30:37.716126+00:00) securityworker stdout | 2022-11-28 08:30:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:30:37,853 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:30:37,854 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:30:39,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:30:39,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:39,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:30:39,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:30:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:30:39,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 08:30:39,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:30:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:35:41 UTC)" (scheduled at 2022-11-28 08:30:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:30:41,221 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:35:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:30:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:52 UTC)" (scheduled at 2022-11-28 08:30:42.901291+00:00) notificationworker stdout | 2022-11-28 08:30:42,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:30:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:30:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:15 UTC)" (scheduled at 2022-11-28 08:30:45.911636+00:00) securityworker stdout | 2022-11-28 08:30:46,058 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:30:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:17 UTC)" (scheduled at 2022-11-28 08:30:47.016425+00:00) gcworker stdout | 2022-11-28 08:30:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:30:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:35:48 UTC)" (scheduled at 2022-11-28 08:30:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:30:48,099 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:35:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:30:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:50 UTC)" (scheduled at 2022-11-28 08:30:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:30:50,202 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:30:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:51 UTC)" (scheduled at 2022-11-28 08:30:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:30:51,816 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:30:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:02 UTC)" (scheduled at 2022-11-28 08:30:52.901291+00:00) notificationworker stdout | 2022-11-28 08:30:52,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:30:53,121 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:23 UTC)" (scheduled at 2022-11-28 08:30:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:30:53,165 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:30:54,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:30:54,494 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) gunicorn-web stdout | 2022-11-28 08:30:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:30:54,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:30:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:30:54,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.142 118 0.142) gunicorn-web stdout | 2022-11-28 08:30:54,614 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) gunicorn-web stdout | 2022-11-28 08:30:54,632 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:30:56,165 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:56 UTC)" (scheduled at 2022-11-28 08:30:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:30:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:30:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:57 UTC)" (scheduled at 2022-11-28 08:30:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:30:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:31:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:31:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:12 UTC)" (scheduled at 2022-11-28 08:31:02.901291+00:00) notificationworker stdout | 2022-11-28 08:31:02,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:31:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:03 UTC)" (scheduled at 2022-11-28 08:31:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:31:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:31:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:06 UTC)" (scheduled at 2022-11-28 08:31:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:31:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:31:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:37 UTC)" (scheduled at 2022-11-28 08:31:07.716126+00:00) securityworker stdout | 2022-11-28 08:31:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:31:07,890 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:31:07,891 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:31:09,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:31:09,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:31:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:31:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:31:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:31:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 08:31:09,577 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:31:09,581 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:31:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:22 UTC)" (scheduled at 2022-11-28 08:31:12.901291+00:00) notificationworker stdout | 2022-11-28 08:31:12,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:31:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:15 UTC)" (scheduled at 2022-11-28 08:31:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:31:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:31:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:45 UTC)" (scheduled at 2022-11-28 08:31:15.911636+00:00) securityworker stdout | 2022-11-28 08:31:15,963 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:31:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:47 UTC)" (scheduled at 2022-11-28 08:31:17.016425+00:00) gcworker stdout | 2022-11-28 08:31:17,097 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:31:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:32 UTC)" (scheduled at 2022-11-28 08:31:22.901291+00:00) notificationworker stdout | 2022-11-28 08:31:22,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:31:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:53 UTC)" (scheduled at 2022-11-28 08:31:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:31:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:31:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:31:24,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.005) gunicorn-registry stdout | 2022-11-28 08:31:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:31:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:31:24,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:31:24,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:31:24,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:31:24,544 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 08:31:24,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 08:31:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:42 UTC)" (scheduled at 2022-11-28 08:31:32.901291+00:00) notificationworker stdout | 2022-11-28 08:31:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:31:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:33 UTC)" (scheduled at 2022-11-28 08:31:33.026570+00:00) notificationworker stdout | 2022-11-28 08:31:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:31:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:33 UTC)" (scheduled at 2022-11-28 08:31:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:31:33,388 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:31:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:07 UTC)" (scheduled at 2022-11-28 08:31:37.716126+00:00) securityworker stdout | 2022-11-28 08:31:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:31:37,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:31:37,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:31:39,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 08:31:39,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:31:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.008) gunicorn-web stdout | 2022-11-28 08:31:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:31:39,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:31:39,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:31:39,544 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:31:39,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:31:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:52 UTC)" (scheduled at 2022-11-28 08:31:42.901291+00:00) notificationworker stdout | 2022-11-28 08:31:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:31:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:31:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:15 UTC)" (scheduled at 2022-11-28 08:31:45.911636+00:00) securityworker stdout | 2022-11-28 08:31:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:31:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:17 UTC)" (scheduled at 2022-11-28 08:31:47.016425+00:00) gcworker stdout | 2022-11-28 08:31:47,105 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:31:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:50 UTC)" (scheduled at 2022-11-28 08:31:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:31:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:31:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:51 UTC)" (scheduled at 2022-11-28 08:31:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:31:51,790 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:31:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:02 UTC)" (scheduled at 2022-11-28 08:31:52.901291+00:00) notificationworker stdout | 2022-11-28 08:31:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:31:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:23 UTC)" (scheduled at 2022-11-28 08:31:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:31:53,202 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:31:54,501 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:31:54,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:31:54,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:31:54,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:31:54,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:31:54,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:31:54,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:31:54,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) securityscanningnotificationworker stdout | 2022-11-28 08:31:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:56 UTC)" (scheduled at 2022-11-28 08:31:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:31:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:31:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:57 UTC)" (scheduled at 2022-11-28 08:31:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:31:57,577 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:32:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:32:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:12 UTC)" (scheduled at 2022-11-28 08:32:02.901291+00:00) notificationworker stdout | 2022-11-28 08:32:02,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:32:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:03 UTC)" (scheduled at 2022-11-28 08:32:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:32:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:32:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:06 UTC)" (scheduled at 2022-11-28 08:32:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:32:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:32:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:37 UTC)" (scheduled at 2022-11-28 08:32:07.716126+00:00) securityworker stdout | 2022-11-28 08:32:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:32:07,834 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:32:07,835 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:32:09,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 08:32:09,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:32:09,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:32:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:32:09,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:32:09,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.098) notificationworker stdout | 2022-11-28 08:32:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:22 UTC)" (scheduled at 2022-11-28 08:32:12.901291+00:00) notificationworker stdout | 2022-11-28 08:32:12,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:32:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:15 UTC)" (scheduled at 2022-11-28 08:32:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:32:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:32:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:45 UTC)" (scheduled at 2022-11-28 08:32:15.911636+00:00) securityworker stdout | 2022-11-28 08:32:16,027 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:32:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:47 UTC)" (scheduled at 2022-11-28 08:32:17.016425+00:00) gcworker stdout | 2022-11-28 08:32:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:32:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:32 UTC)" (scheduled at 2022-11-28 08:32:22.901291+00:00) notificationworker stdout | 2022-11-28 08:32:23,004 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:32:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:53 UTC)" (scheduled at 2022-11-28 08:32:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:32:23,171 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:32:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:32:24,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:32:24,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:32:24,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:32:24,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:32:24,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 08:32:24,586 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:32:24,592 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) notificationworker stdout | 2022-11-28 08:32:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:42 UTC)" (scheduled at 2022-11-28 08:32:32.901291+00:00) notificationworker stdout | 2022-11-28 08:32:32,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:32:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:33 UTC)" (scheduled at 2022-11-28 08:32:33.026570+00:00) notificationworker stdout | 2022-11-28 08:32:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:32:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:33 UTC)" (scheduled at 2022-11-28 08:32:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:32:33,350 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:32:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:07 UTC)" (scheduled at 2022-11-28 08:32:37.716126+00:00) securityworker stdout | 2022-11-28 08:32:37,770 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:32:37,819 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:32:37,820 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:32:39,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:32:39,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:32:39,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:32:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:32:39,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 08:32:39,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:32:39,545 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) notificationworker stdout | 2022-11-28 08:32:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:52 UTC)" (scheduled at 2022-11-28 08:32:42.901291+00:00) notificationworker stdout | 2022-11-28 08:32:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:32:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:32:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:15 UTC)" (scheduled at 2022-11-28 08:32:45.911636+00:00) securityworker stdout | 2022-11-28 08:32:45,970 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:32:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:17 UTC)" (scheduled at 2022-11-28 08:32:47.016425+00:00) gcworker stdout | 2022-11-28 08:32:47,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:32:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:50 UTC)" (scheduled at 2022-11-28 08:32:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:32:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:32:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:51 UTC)" (scheduled at 2022-11-28 08:32:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:32:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:32:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:02 UTC)" (scheduled at 2022-11-28 08:32:52.901291+00:00) notificationworker stdout | 2022-11-28 08:32:52,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:32:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:23 UTC)" (scheduled at 2022-11-28 08:32:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:32:53,173 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:32:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:32:54,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:54,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:32:54,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.002) gunicorn-web stdout | 2022-11-28 08:32:54,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:32:54,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:32:54,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:32:54,584 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) securityscanningnotificationworker stdout | 2022-11-28 08:32:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:56 UTC)" (scheduled at 2022-11-28 08:32:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:32:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:32:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:57 UTC)" (scheduled at 2022-11-28 08:32:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:32:57,651 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:33:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:33:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:12 UTC)" (scheduled at 2022-11-28 08:33:02.901291+00:00) notificationworker stdout | 2022-11-28 08:33:02,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:33:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:03 UTC)" (scheduled at 2022-11-28 08:33:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:33:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:33:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:06 UTC)" (scheduled at 2022-11-28 08:33:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:33:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:33:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:37 UTC)" (scheduled at 2022-11-28 08:33:07.716126+00:00) securityworker stdout | 2022-11-28 08:33:07,752 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:33:07,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:33:07,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:33:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:33:09,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:33:09,503 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.021 162 0.021) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:33:09,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:09,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 08:33:09,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 08:33:09,600 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:33:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:22 UTC)" (scheduled at 2022-11-28 08:33:12.901291+00:00) notificationworker stdout | 2022-11-28 08:33:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:33:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:15 UTC)" (scheduled at 2022-11-28 08:33:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:33:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:33:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:45 UTC)" (scheduled at 2022-11-28 08:33:15.911636+00:00) securityworker stdout | 2022-11-28 08:33:15,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:33:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:47 UTC)" (scheduled at 2022-11-28 08:33:17.016425+00:00) gcworker stdout | 2022-11-28 08:33:17,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:33:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:32 UTC)" (scheduled at 2022-11-28 08:33:22.901291+00:00) notificationworker stdout | 2022-11-28 08:33:22,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:33:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:53 UTC)" (scheduled at 2022-11-28 08:33:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:33:23,192 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:33:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:33:24,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:33:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:33:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:24,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:33:24,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:33:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.175 118 0.175) gunicorn-web stdout | 2022-11-28 08:33:24,647 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.186 118 0.186) gunicorn-web stdout | 2022-11-28 08:33:24,658 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:33:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:42 UTC)" (scheduled at 2022-11-28 08:33:32.901291+00:00) notificationworker stdout | 2022-11-28 08:33:32,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:33:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:33 UTC)" (scheduled at 2022-11-28 08:33:33.026570+00:00) notificationworker stdout | 2022-11-28 08:33:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:33:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:33 UTC)" (scheduled at 2022-11-28 08:33:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:33:33,364 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:33:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:07 UTC)" (scheduled at 2022-11-28 08:33:37.716126+00:00) securityworker stdout | 2022-11-28 08:33:37,745 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:33:37,843 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:33:37,844 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:33:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:38:38 UTC)" (scheduled at 2022-11-28 08:33:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:33:38,479 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:38:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:33:39,494 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:33:39,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 08:33:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:33:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:33:39,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:39,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:33:39,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:33:39,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 08:33:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:52 UTC)" (scheduled at 2022-11-28 08:33:42.901291+00:00) notificationworker stdout | 2022-11-28 08:33:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:33:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:33:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:15 UTC)" (scheduled at 2022-11-28 08:33:45.911636+00:00) securityworker stdout | 2022-11-28 08:33:45,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:33:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:17 UTC)" (scheduled at 2022-11-28 08:33:47.016425+00:00) gcworker stdout | 2022-11-28 08:33:47,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:33:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:38:49 UTC)" (scheduled at 2022-11-28 08:33:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:33:49,439 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:38:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:33:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:50 UTC)" (scheduled at 2022-11-28 08:33:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:33:50,176 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:33:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:51 UTC)" (scheduled at 2022-11-28 08:33:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:33:51,845 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:33:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:02 UTC)" (scheduled at 2022-11-28 08:33:52.901291+00:00) notificationworker stdout | 2022-11-28 08:33:52,973 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:33:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:23 UTC)" (scheduled at 2022-11-28 08:33:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:33:53,193 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:33:54,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:33:54,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:33:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:33:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:33:54,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:33:54,555 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 08:33:54,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) securityscanningnotificationworker stdout | 2022-11-28 08:33:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:56 UTC)" (scheduled at 2022-11-28 08:33:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:33:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:33:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:57 UTC)" (scheduled at 2022-11-28 08:33:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:33:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:34:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:34:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:12 UTC)" (scheduled at 2022-11-28 08:34:02.901291+00:00) notificationworker stdout | 2022-11-28 08:34:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:34:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:03 UTC)" (scheduled at 2022-11-28 08:34:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:34:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:34:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:06 UTC)" (scheduled at 2022-11-28 08:34:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:34:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:34:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:37 UTC)" (scheduled at 2022-11-28 08:34:07.716126+00:00) securityworker stdout | 2022-11-28 08:34:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:34:07,801 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:34:07,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:34:09,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:34:09,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:34:09,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:09,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:34:09,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:09,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.057 118 0.057) gunicorn-web stdout | 2022-11-28 08:34:09,528 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:34:09,529 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) notificationworker stdout | 2022-11-28 08:34:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:22 UTC)" (scheduled at 2022-11-28 08:34:12.901291+00:00) notificationworker stdout | 2022-11-28 08:34:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:34:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:15 UTC)" (scheduled at 2022-11-28 08:34:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:34:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:34:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:45 UTC)" (scheduled at 2022-11-28 08:34:15.911636+00:00) securityworker stdout | 2022-11-28 08:34:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:34:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:47 UTC)" (scheduled at 2022-11-28 08:34:17.016425+00:00) gcworker stdout | 2022-11-28 08:34:17,078 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:34:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:32 UTC)" (scheduled at 2022-11-28 08:34:22.901291+00:00) notificationworker stdout | 2022-11-28 08:34:22,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:34:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:53 UTC)" (scheduled at 2022-11-28 08:34:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:34:23,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:34:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:34:24,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:34:24,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:34:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:24,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:34:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 08:34:24,561 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) gunicorn-web stdout | 2022-11-28 08:34:24,579 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:34:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:42 UTC)" (scheduled at 2022-11-28 08:34:32.901291+00:00) notificationworker stdout | 2022-11-28 08:34:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:34:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:33 UTC)" (scheduled at 2022-11-28 08:34:33.026570+00:00) notificationworker stdout | 2022-11-28 08:34:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:34:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:33 UTC)" (scheduled at 2022-11-28 08:34:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:34:33,389 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:34:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:07 UTC)" (scheduled at 2022-11-28 08:34:37.716126+00:00) securityworker stdout | 2022-11-28 08:34:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:34:37,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:34:37,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:34:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:39:38 UTC)" (scheduled at 2022-11-28 08:34:38.024004+00:00) notificationworker stdout | 2022-11-28 08:34:38,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:39:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:34:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:34:39,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:34:39,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:39,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:34:39,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:34:39,548 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:34:39,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) notificationworker stdout | 2022-11-28 08:34:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:52 UTC)" (scheduled at 2022-11-28 08:34:42.901291+00:00) notificationworker stdout | 2022-11-28 08:34:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:34:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:34:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:15 UTC)" (scheduled at 2022-11-28 08:34:45.911636+00:00) securityworker stdout | 2022-11-28 08:34:45,950 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:34:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:17 UTC)" (scheduled at 2022-11-28 08:34:47.016425+00:00) gcworker stdout | 2022-11-28 08:34:47,078 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:34:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:50 UTC)" (scheduled at 2022-11-28 08:34:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:34:50,184 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:34:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:51 UTC)" (scheduled at 2022-11-28 08:34:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:34:51,798 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:34:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:02 UTC)" (scheduled at 2022-11-28 08:34:52.901291+00:00) notificationworker stdout | 2022-11-28 08:34:52,992 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:34:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:23 UTC)" (scheduled at 2022-11-28 08:34:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:34:53,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:34:54,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:34:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:54,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:34:54,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:34:54,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:34:54,498 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:34:54,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:34:54,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) securityscanningnotificationworker stdout | 2022-11-28 08:34:56,166 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:56 UTC)" (scheduled at 2022-11-28 08:34:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:34:56,167 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:34:57,517 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:57 UTC)" (scheduled at 2022-11-28 08:34:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:34:57,547 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:35:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:35:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:12 UTC)" (scheduled at 2022-11-28 08:35:02.901291+00:00) notificationworker stdout | 2022-11-28 08:35:02,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:35:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:03 UTC)" (scheduled at 2022-11-28 08:35:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:35:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:35:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:06 UTC)" (scheduled at 2022-11-28 08:35:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:35:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:35:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:37 UTC)" (scheduled at 2022-11-28 08:35:07.716126+00:00) securityworker stdout | 2022-11-28 08:35:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:35:07,780 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:35:07,781 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 08:35:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:35:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:35:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:35:09,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:35:09,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 08:35:09,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.149 118 0.149) gunicorn-web stdout | 2022-11-28 08:35:09,621 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:35:09,624 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.152 118 0.152) notificationworker stdout | 2022-11-28 08:35:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:22 UTC)" (scheduled at 2022-11-28 08:35:12.901291+00:00) notificationworker stdout | 2022-11-28 08:35:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:35:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:15 UTC)" (scheduled at 2022-11-28 08:35:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:35:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:35:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:45 UTC)" (scheduled at 2022-11-28 08:35:15.911636+00:00) securityworker stdout | 2022-11-28 08:35:15,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:35:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:47 UTC)" (scheduled at 2022-11-28 08:35:17.016425+00:00) gcworker stdout | 2022-11-28 08:35:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:35:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:32 UTC)" (scheduled at 2022-11-28 08:35:22.901291+00:00) notificationworker stdout | 2022-11-28 08:35:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:35:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:53 UTC)" (scheduled at 2022-11-28 08:35:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:35:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:35:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:35:24,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:35:24,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:35:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:35:24,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:35:24,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:35:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:35:24,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:35:24,565 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.091) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.090) notificationworker stdout | 2022-11-28 08:35:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:42 UTC)" (scheduled at 2022-11-28 08:35:32.901291+00:00) notificationworker stdout | 2022-11-28 08:35:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:35:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:33 UTC)" (scheduled at 2022-11-28 08:35:33.026570+00:00) notificationworker stdout | 2022-11-28 08:35:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:35:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:33 UTC)" (scheduled at 2022-11-28 08:35:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:35:33,375 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:35:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:07 UTC)" (scheduled at 2022-11-28 08:35:37.716126+00:00) securityworker stdout | 2022-11-28 08:35:37,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:35:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:35:37,771 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:35:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.008) gunicorn-registry stdout | 2022-11-28 08:35:39,503 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.008) gunicorn-web stdout | 2022-11-28 08:35:39,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:35:39,517 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:35:39,522 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:35:39,525 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:35:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:35:39,564 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) securityscanningnotificationworker stdout | 2022-11-28 08:35:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:40:41 UTC)" (scheduled at 2022-11-28 08:35:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:35:41,209 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:40:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:35:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:52 UTC)" (scheduled at 2022-11-28 08:35:42.901291+00:00) notificationworker stdout | 2022-11-28 08:35:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:35:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:35:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:15 UTC)" (scheduled at 2022-11-28 08:35:45.911636+00:00) securityworker stdout | 2022-11-28 08:35:45,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:35:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:17 UTC)" (scheduled at 2022-11-28 08:35:47.016425+00:00) gcworker stdout | 2022-11-28 08:35:47,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:35:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:40:48 UTC)" (scheduled at 2022-11-28 08:35:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:35:48,091 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:40:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:35:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:50 UTC)" (scheduled at 2022-11-28 08:35:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:35:50,158 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:35:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:51 UTC)" (scheduled at 2022-11-28 08:35:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:35:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:35:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:02 UTC)" (scheduled at 2022-11-28 08:35:52.901291+00:00) notificationworker stdout | 2022-11-28 08:35:52,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:35:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:23 UTC)" (scheduled at 2022-11-28 08:35:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:35:53,140 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.011) gunicorn-registry stdout | 2022-11-28 08:35:54,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:35:54,503 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:35:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:35:54,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:35:54,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 08:35:54,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:35:54,616 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) gunicorn-web stdout | 2022-11-28 08:35:54,634 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.157) securityscanningnotificationworker stdout | 2022-11-28 08:35:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:56 UTC)" (scheduled at 2022-11-28 08:35:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:35:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:35:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:57 UTC)" (scheduled at 2022-11-28 08:35:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:35:57,550 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:36:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:36:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:12 UTC)" (scheduled at 2022-11-28 08:36:02.901291+00:00) notificationworker stdout | 2022-11-28 08:36:02,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:36:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:03 UTC)" (scheduled at 2022-11-28 08:36:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:36:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:36:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:06 UTC)" (scheduled at 2022-11-28 08:36:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:36:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:36:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:37 UTC)" (scheduled at 2022-11-28 08:36:07.716126+00:00) securityworker stdout | 2022-11-28 08:36:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:36:07,757 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:36:07,757 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:36:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:36:09,495 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.008) gunicorn-web stdout | 2022-11-28 08:36:09,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:36:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:36:09,516 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:36:09,518 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:36:09,568 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:36:09,569 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.094) notificationworker stdout | 2022-11-28 08:36:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:22 UTC)" (scheduled at 2022-11-28 08:36:12.901291+00:00) notificationworker stdout | 2022-11-28 08:36:12,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:36:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:15 UTC)" (scheduled at 2022-11-28 08:36:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:36:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:36:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:45 UTC)" (scheduled at 2022-11-28 08:36:15.911636+00:00) securityworker stdout | 2022-11-28 08:36:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:36:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:47 UTC)" (scheduled at 2022-11-28 08:36:17.016425+00:00) gcworker stdout | 2022-11-28 08:36:17,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:36:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:32 UTC)" (scheduled at 2022-11-28 08:36:22.901291+00:00) notificationworker stdout | 2022-11-28 08:36:22,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:36:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:53 UTC)" (scheduled at 2022-11-28 08:36:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:36:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:36:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:36:24,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:36:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-web stdout | 2022-11-28 08:36:24,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.003) gunicorn-web stdout | 2022-11-28 08:36:24,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:36:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:36:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:36:24,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 08:36:24,580 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:36:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:42 UTC)" (scheduled at 2022-11-28 08:36:32.901291+00:00) notificationworker stdout | 2022-11-28 08:36:32,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:36:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:33 UTC)" (scheduled at 2022-11-28 08:36:33.026570+00:00) notificationworker stdout | 2022-11-28 08:36:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:36:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:33 UTC)" (scheduled at 2022-11-28 08:36:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:36:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:36:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:07 UTC)" (scheduled at 2022-11-28 08:36:37.716126+00:00) securityworker stdout | 2022-11-28 08:36:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:36:37,801 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:36:37,803 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:36:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:36:39,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:36:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:36:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:36:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:36:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:36:39,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:36:39,554 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:36:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:52 UTC)" (scheduled at 2022-11-28 08:36:42.901291+00:00) notificationworker stdout | 2022-11-28 08:36:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:36:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:36:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:15 UTC)" (scheduled at 2022-11-28 08:36:45.911636+00:00) securityworker stdout | 2022-11-28 08:36:46,003 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:36:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:17 UTC)" (scheduled at 2022-11-28 08:36:47.016425+00:00) gcworker stdout | 2022-11-28 08:36:47,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:36:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:50 UTC)" (scheduled at 2022-11-28 08:36:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:36:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:36:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:51 UTC)" (scheduled at 2022-11-28 08:36:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:36:51,776 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:36:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:02 UTC)" (scheduled at 2022-11-28 08:36:52.901291+00:00) notificationworker stdout | 2022-11-28 08:36:52,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:36:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:23 UTC)" (scheduled at 2022-11-28 08:36:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:36:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:36:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:36:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:36:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:36:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 08:36:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:36:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:36:54,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:36:54,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.073) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.074) securityscanningnotificationworker stdout | 2022-11-28 08:36:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:56 UTC)" (scheduled at 2022-11-28 08:36:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:36:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:36:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:57 UTC)" (scheduled at 2022-11-28 08:36:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:36:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:37:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:37:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:12 UTC)" (scheduled at 2022-11-28 08:37:02.901291+00:00) notificationworker stdout | 2022-11-28 08:37:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:37:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:03 UTC)" (scheduled at 2022-11-28 08:37:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:37:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:37:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:06 UTC)" (scheduled at 2022-11-28 08:37:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:37:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:37:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:37 UTC)" (scheduled at 2022-11-28 08:37:07.716126+00:00) securityworker stdout | 2022-11-28 08:37:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:37:07,758 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:37:07,759 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 08:37:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:37:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:37:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:37:09,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:37:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:37:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.057) gunicorn-web stdout | 2022-11-28 08:37:09,530 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 08:37:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:37:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:22 UTC)" (scheduled at 2022-11-28 08:37:12.901291+00:00) notificationworker stdout | 2022-11-28 08:37:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:37:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:15 UTC)" (scheduled at 2022-11-28 08:37:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:37:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:37:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:45 UTC)" (scheduled at 2022-11-28 08:37:15.911636+00:00) securityworker stdout | 2022-11-28 08:37:15,951 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:37:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:47 UTC)" (scheduled at 2022-11-28 08:37:17.016425+00:00) gcworker stdout | 2022-11-28 08:37:17,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:37:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:32 UTC)" (scheduled at 2022-11-28 08:37:22.901291+00:00) notificationworker stdout | 2022-11-28 08:37:22,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:37:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:53 UTC)" (scheduled at 2022-11-28 08:37:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:37:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:37:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:37:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:37:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:37:24,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:37:24,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:37:24,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:37:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 08:37:24,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:37:24,565 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:37:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:42 UTC)" (scheduled at 2022-11-28 08:37:32.901291+00:00) notificationworker stdout | 2022-11-28 08:37:32,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:37:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:33 UTC)" (scheduled at 2022-11-28 08:37:33.026570+00:00) notificationworker stdout | 2022-11-28 08:37:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:37:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:33 UTC)" (scheduled at 2022-11-28 08:37:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:37:33,342 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:37:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:07 UTC)" (scheduled at 2022-11-28 08:37:37.716126+00:00) securityworker stdout | 2022-11-28 08:37:37,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:37:37,775 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:37:37,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:37:39,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:37:39,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:37:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:37:39,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:37:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:37:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 08:37:39,542 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:37:39,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 08:37:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:52 UTC)" (scheduled at 2022-11-28 08:37:42.901291+00:00) notificationworker stdout | 2022-11-28 08:37:42,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:37:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:37:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:15 UTC)" (scheduled at 2022-11-28 08:37:45.911636+00:00) securityworker stdout | 2022-11-28 08:37:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:37:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:17 UTC)" (scheduled at 2022-11-28 08:37:47.016425+00:00) gcworker stdout | 2022-11-28 08:37:47,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:37:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:50 UTC)" (scheduled at 2022-11-28 08:37:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:37:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:37:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:51 UTC)" (scheduled at 2022-11-28 08:37:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:37:51,777 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:37:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:02 UTC)" (scheduled at 2022-11-28 08:37:52.901291+00:00) notificationworker stdout | 2022-11-28 08:37:52,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:37:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:23 UTC)" (scheduled at 2022-11-28 08:37:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:37:53,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:37:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:37:54,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:37:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:37:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:37:54,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:37:54,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:37:54,599 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.127) gunicorn-web stdout | 2022-11-28 08:37:54,601 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.128) securityscanningnotificationworker stdout | 2022-11-28 08:37:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:56 UTC)" (scheduled at 2022-11-28 08:37:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:37:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:37:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:57 UTC)" (scheduled at 2022-11-28 08:37:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:37:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:38:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:38:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:12 UTC)" (scheduled at 2022-11-28 08:38:02.901291+00:00) notificationworker stdout | 2022-11-28 08:38:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:38:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:03 UTC)" (scheduled at 2022-11-28 08:38:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:38:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:38:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:06 UTC)" (scheduled at 2022-11-28 08:38:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:38:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:38:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:37 UTC)" (scheduled at 2022-11-28 08:38:07.716126+00:00) securityworker stdout | 2022-11-28 08:38:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:38:07,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:38:07,783 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:38:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:38:09,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:09,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:38:09,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:38:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:38:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) gunicorn-web stdout | 2022-11-28 08:38:09,531 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:38:09,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) notificationworker stdout | 2022-11-28 08:38:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:22 UTC)" (scheduled at 2022-11-28 08:38:12.901291+00:00) notificationworker stdout | 2022-11-28 08:38:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:38:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:15 UTC)" (scheduled at 2022-11-28 08:38:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:38:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:38:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:45 UTC)" (scheduled at 2022-11-28 08:38:15.911636+00:00) securityworker stdout | 2022-11-28 08:38:15,954 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:38:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:47 UTC)" (scheduled at 2022-11-28 08:38:17.016425+00:00) gcworker stdout | 2022-11-28 08:38:17,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:38:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:32 UTC)" (scheduled at 2022-11-28 08:38:22.901291+00:00) notificationworker stdout | 2022-11-28 08:38:22,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:38:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:53 UTC)" (scheduled at 2022-11-28 08:38:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:38:23,171 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:38:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:38:24,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:38:24,502 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:24,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:38:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:38:24,525 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:24,530 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:38:24,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 08:38:24,595 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:38:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:42 UTC)" (scheduled at 2022-11-28 08:38:32.901291+00:00) notificationworker stdout | 2022-11-28 08:38:32,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:38:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:33 UTC)" (scheduled at 2022-11-28 08:38:33.026570+00:00) notificationworker stdout | 2022-11-28 08:38:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:38:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:33 UTC)" (scheduled at 2022-11-28 08:38:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:38:33,350 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:38:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:07 UTC)" (scheduled at 2022-11-28 08:38:37.716126+00:00) securityworker stdout | 2022-11-28 08:38:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:38:37,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:38:37,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:38:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:43:38 UTC)" (scheduled at 2022-11-28 08:38:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:38:38,459 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:43:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 08:38:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:38:39,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:38:39,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:39,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:38:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:38:39,541 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 08:38:39,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:38:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:52 UTC)" (scheduled at 2022-11-28 08:38:42.901291+00:00) notificationworker stdout | 2022-11-28 08:38:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:38:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:38:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:15 UTC)" (scheduled at 2022-11-28 08:38:45.911636+00:00) securityworker stdout | 2022-11-28 08:38:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:38:47,021 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:17 UTC)" (scheduled at 2022-11-28 08:38:47.016425+00:00) gcworker stdout | 2022-11-28 08:38:47,090 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:38:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:43:49 UTC)" (scheduled at 2022-11-28 08:38:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:38:49,456 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:43:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:38:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:50 UTC)" (scheduled at 2022-11-28 08:38:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:38:50,174 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:38:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:51 UTC)" (scheduled at 2022-11-28 08:38:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:38:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:38:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:02 UTC)" (scheduled at 2022-11-28 08:38:52.901291+00:00) notificationworker stdout | 2022-11-28 08:38:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:38:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:23 UTC)" (scheduled at 2022-11-28 08:38:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:38:53,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:38:54,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:38:54,498 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:38:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:38:54,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:38:54,521 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:38:54,524 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:38:54,595 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 08:38:54,599 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:38:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:56 UTC)" (scheduled at 2022-11-28 08:38:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:38:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:38:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:57 UTC)" (scheduled at 2022-11-28 08:38:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:38:57,568 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:39:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:39:02,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:12 UTC)" (scheduled at 2022-11-28 08:39:02.901291+00:00) notificationworker stdout | 2022-11-28 08:39:02,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:39:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:03 UTC)" (scheduled at 2022-11-28 08:39:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:39:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:39:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:06 UTC)" (scheduled at 2022-11-28 08:39:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:39:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:39:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:37 UTC)" (scheduled at 2022-11-28 08:39:07.716126+00:00) securityworker stdout | 2022-11-28 08:39:07,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:39:07,773 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:39:07,774 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:37 UTC)" executed successfully manifestbackfillworker stdout | 2022-11-28 08:39:08,422 [72] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 09:39:08 UTC)" (scheduled at 2022-11-28 08:39:08.421529+00:00) manifestbackfillworker stdout | 2022-11-28 08:39:08,441 [72] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 09:39:08 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:39:09,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:39:09,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:09,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:39:09,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:39:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:39:09,529 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 08:39:09,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:39:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:22 UTC)" (scheduled at 2022-11-28 08:39:12.901291+00:00) notificationworker stdout | 2022-11-28 08:39:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:39:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:15 UTC)" (scheduled at 2022-11-28 08:39:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:39:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:39:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:45 UTC)" (scheduled at 2022-11-28 08:39:15.911636+00:00) securityworker stdout | 2022-11-28 08:39:15,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:39:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:47 UTC)" (scheduled at 2022-11-28 08:39:17.016425+00:00) gcworker stdout | 2022-11-28 08:39:17,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:39:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:32 UTC)" (scheduled at 2022-11-28 08:39:22.901291+00:00) notificationworker stdout | 2022-11-28 08:39:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:39:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:53 UTC)" (scheduled at 2022-11-28 08:39:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:39:23,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:39:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:39:24,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:39:24,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:24,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:39:24,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:24,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:39:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:39:24,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 08:39:24,573 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:39:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:42 UTC)" (scheduled at 2022-11-28 08:39:32.901291+00:00) notificationworker stdout | 2022-11-28 08:39:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:39:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:33 UTC)" (scheduled at 2022-11-28 08:39:33.026570+00:00) notificationworker stdout | 2022-11-28 08:39:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:39:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:33 UTC)" (scheduled at 2022-11-28 08:39:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:39:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:39:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:07 UTC)" (scheduled at 2022-11-28 08:39:37.716126+00:00) securityworker stdout | 2022-11-28 08:39:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:39:37,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:39:37,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:39:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:44:38 UTC)" (scheduled at 2022-11-28 08:39:38.024004+00:00) notificationworker stdout | 2022-11-28 08:39:38,058 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:44:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:39:39,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:39:39,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 08:39:39,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:39,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:39:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:39:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:39:39,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:39:39,547 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) notificationworker stdout | 2022-11-28 08:39:42,909 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:52 UTC)" (scheduled at 2022-11-28 08:39:42.901291+00:00) notificationworker stdout | 2022-11-28 08:39:42,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:39:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:39:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:15 UTC)" (scheduled at 2022-11-28 08:39:45.911636+00:00) securityworker stdout | 2022-11-28 08:39:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:39:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:17 UTC)" (scheduled at 2022-11-28 08:39:47.016425+00:00) gcworker stdout | 2022-11-28 08:39:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:39:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:50 UTC)" (scheduled at 2022-11-28 08:39:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:39:50,176 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:39:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:51 UTC)" (scheduled at 2022-11-28 08:39:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:39:51,789 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:39:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:02 UTC)" (scheduled at 2022-11-28 08:39:52.901291+00:00) notificationworker stdout | 2022-11-28 08:39:52,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:39:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:23 UTC)" (scheduled at 2022-11-28 08:39:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:39:53,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:39:54,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:39:54,497 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:39:54,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:39:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:39:54,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:39:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:39:54,551 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:39:54,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) securityscanningnotificationworker stdout | 2022-11-28 08:39:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:56 UTC)" (scheduled at 2022-11-28 08:39:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:39:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:39:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:57 UTC)" (scheduled at 2022-11-28 08:39:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:39:57,572 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:40:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:40:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:12 UTC)" (scheduled at 2022-11-28 08:40:02.901291+00:00) notificationworker stdout | 2022-11-28 08:40:02,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:40:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:03 UTC)" (scheduled at 2022-11-28 08:40:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:40:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:40:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:06 UTC)" (scheduled at 2022-11-28 08:40:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:40:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:40:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:37 UTC)" (scheduled at 2022-11-28 08:40:07.716126+00:00) securityworker stdout | 2022-11-28 08:40:07,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:40:07,893 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:40:07,893 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:40:09,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:40:09,495 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:40:09,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:40:09,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:40:09,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:40:09,513 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 08:40:09,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 08:40:09,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:40:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:22 UTC)" (scheduled at 2022-11-28 08:40:12.901291+00:00) notificationworker stdout | 2022-11-28 08:40:12,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:40:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:15 UTC)" (scheduled at 2022-11-28 08:40:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:40:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:40:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:45 UTC)" (scheduled at 2022-11-28 08:40:15.911636+00:00) securityworker stdout | 2022-11-28 08:40:15,963 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:40:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:47 UTC)" (scheduled at 2022-11-28 08:40:17.016425+00:00) gcworker stdout | 2022-11-28 08:40:17,105 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:40:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:32 UTC)" (scheduled at 2022-11-28 08:40:22.901291+00:00) notificationworker stdout | 2022-11-28 08:40:22,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:40:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:53 UTC)" (scheduled at 2022-11-28 08:40:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:40:23,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:40:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:40:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:40:24,494 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.001) gunicorn-web stdout | 2022-11-28 08:40:24,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:40:24,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:40:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:40:24,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.097) gunicorn-web stdout | 2022-11-28 08:40:24,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:40:24,581 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.110) notificationworker stdout | 2022-11-28 08:40:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:42 UTC)" (scheduled at 2022-11-28 08:40:32.901291+00:00) notificationworker stdout | 2022-11-28 08:40:32,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:40:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:33 UTC)" (scheduled at 2022-11-28 08:40:33.026570+00:00) notificationworker stdout | 2022-11-28 08:40:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:40:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:33 UTC)" (scheduled at 2022-11-28 08:40:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:40:33,396 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:40:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:07 UTC)" (scheduled at 2022-11-28 08:40:37.716126+00:00) securityworker stdout | 2022-11-28 08:40:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:40:37,821 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:40:37,822 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:40:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:40:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:40:39,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:40:39,497 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:40:39,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:40:39,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) gunicorn-web stdout | 2022-11-28 08:40:39,582 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 08:40:39,589 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:40:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:45:41 UTC)" (scheduled at 2022-11-28 08:40:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:40:41,246 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:45:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:40:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:52 UTC)" (scheduled at 2022-11-28 08:40:42.901291+00:00) notificationworker stdout | 2022-11-28 08:40:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:40:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:40:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:15 UTC)" (scheduled at 2022-11-28 08:40:45.911636+00:00) securityworker stdout | 2022-11-28 08:40:45,983 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:40:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:17 UTC)" (scheduled at 2022-11-28 08:40:47.016425+00:00) gcworker stdout | 2022-11-28 08:40:47,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:40:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:45:48 UTC)" (scheduled at 2022-11-28 08:40:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:40:48,114 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:45:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:40:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:50 UTC)" (scheduled at 2022-11-28 08:40:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:40:50,169 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:40:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:51 UTC)" (scheduled at 2022-11-28 08:40:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:40:51,775 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:40:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:02 UTC)" (scheduled at 2022-11-28 08:40:52.901291+00:00) notificationworker stdout | 2022-11-28 08:40:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:40:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:23 UTC)" (scheduled at 2022-11-28 08:40:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:40:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:40:54,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:40:54,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:40:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:40:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:40:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:40:54,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) gunicorn-web stdout | 2022-11-28 08:40:54,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 08:40:54,592 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:40:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:56 UTC)" (scheduled at 2022-11-28 08:40:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:40:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:40:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:57 UTC)" (scheduled at 2022-11-28 08:40:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:40:57,601 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:41:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:41:02,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:12 UTC)" (scheduled at 2022-11-28 08:41:02.901291+00:00) notificationworker stdout | 2022-11-28 08:41:02,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:41:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:03 UTC)" (scheduled at 2022-11-28 08:41:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:41:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:41:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:06 UTC)" (scheduled at 2022-11-28 08:41:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:41:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:41:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:37 UTC)" (scheduled at 2022-11-28 08:41:07.716126+00:00) securityworker stdout | 2022-11-28 08:41:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:41:07,962 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:41:07,963 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:41:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:41:09,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:09,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 08:41:09,498 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:41:09,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) gunicorn-web stdout | 2022-11-28 08:41:09,582 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:41:09,644 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.175 118 0.175) notificationworker stdout | 2022-11-28 08:41:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:22 UTC)" (scheduled at 2022-11-28 08:41:12.901291+00:00) notificationworker stdout | 2022-11-28 08:41:12,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:41:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:15 UTC)" (scheduled at 2022-11-28 08:41:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:41:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:41:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:45 UTC)" (scheduled at 2022-11-28 08:41:15.911636+00:00) securityworker stdout | 2022-11-28 08:41:15,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:41:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:47 UTC)" (scheduled at 2022-11-28 08:41:17.016425+00:00) gcworker stdout | 2022-11-28 08:41:17,083 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:41:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:32 UTC)" (scheduled at 2022-11-28 08:41:22.901291+00:00) notificationworker stdout | 2022-11-28 08:41:22,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:41:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:53 UTC)" (scheduled at 2022-11-28 08:41:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:41:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:41:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:41:24,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:41:24,486 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:41:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:41:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:41:24,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:41:24,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 08:41:24,571 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:41:32,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:42 UTC)" (scheduled at 2022-11-28 08:41:32.901291+00:00) notificationworker stdout | 2022-11-28 08:41:33,020 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:41:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:33 UTC)" (scheduled at 2022-11-28 08:41:33.026570+00:00) notificationworker stdout | 2022-11-28 08:41:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:41:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:33 UTC)" (scheduled at 2022-11-28 08:41:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:41:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:41:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:07 UTC)" (scheduled at 2022-11-28 08:41:37.716126+00:00) securityworker stdout | 2022-11-28 08:41:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:41:37,762 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:41:37,763 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:41:39,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:41:39,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:41:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:41:39,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:39,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 08:41:39,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 08:41:39,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:41:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:52 UTC)" (scheduled at 2022-11-28 08:41:42.901291+00:00) notificationworker stdout | 2022-11-28 08:41:42,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:41:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:41:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:15 UTC)" (scheduled at 2022-11-28 08:41:45.911636+00:00) securityworker stdout | 2022-11-28 08:41:45,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:41:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:17 UTC)" (scheduled at 2022-11-28 08:41:47.016425+00:00) gcworker stdout | 2022-11-28 08:41:47,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:41:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:50 UTC)" (scheduled at 2022-11-28 08:41:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:41:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:41:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:51 UTC)" (scheduled at 2022-11-28 08:41:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:41:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:41:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:02 UTC)" (scheduled at 2022-11-28 08:41:52.901291+00:00) notificationworker stdout | 2022-11-28 08:41:53,046 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:41:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:23 UTC)" (scheduled at 2022-11-28 08:41:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:41:53,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:41:54,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:41:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:41:54,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:41:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:41:54,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:41:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:41:54,641 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.169 118 0.169) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.208 118 0.208) gunicorn-web stdout | 2022-11-28 08:41:54,681 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:41:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:56 UTC)" (scheduled at 2022-11-28 08:41:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:41:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:41:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:57 UTC)" (scheduled at 2022-11-28 08:41:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:41:57,668 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:42:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:42:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:12 UTC)" (scheduled at 2022-11-28 08:42:02.901291+00:00) notificationworker stdout | 2022-11-28 08:42:02,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:42:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:03 UTC)" (scheduled at 2022-11-28 08:42:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:42:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:42:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:06 UTC)" (scheduled at 2022-11-28 08:42:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:42:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:42:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:37 UTC)" (scheduled at 2022-11-28 08:42:07.716126+00:00) securityworker stdout | 2022-11-28 08:42:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:42:07,769 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:42:07,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:42:09,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:42:09,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:42:09,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:42:09,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:42:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 08:42:09,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:42:09,547 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:42:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:22 UTC)" (scheduled at 2022-11-28 08:42:12.901291+00:00) notificationworker stdout | 2022-11-28 08:42:12,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:42:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:15 UTC)" (scheduled at 2022-11-28 08:42:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:42:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:42:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:45 UTC)" (scheduled at 2022-11-28 08:42:15.911636+00:00) securityworker stdout | 2022-11-28 08:42:16,030 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:42:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:47 UTC)" (scheduled at 2022-11-28 08:42:17.016425+00:00) gcworker stdout | 2022-11-28 08:42:17,099 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:42:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:32 UTC)" (scheduled at 2022-11-28 08:42:22.901291+00:00) notificationworker stdout | 2022-11-28 08:42:22,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:42:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:53 UTC)" (scheduled at 2022-11-28 08:42:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:42:23,181 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:42:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:42:24,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:42:24,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 08:42:24,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:42:24,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:42:24,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.093) gunicorn-web stdout | 2022-11-28 08:42:24,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.107) gunicorn-web stdout | 2022-11-28 08:42:24,581 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:42:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:42 UTC)" (scheduled at 2022-11-28 08:42:32.901291+00:00) notificationworker stdout | 2022-11-28 08:42:32,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:42:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:33 UTC)" (scheduled at 2022-11-28 08:42:33.026570+00:00) notificationworker stdout | 2022-11-28 08:42:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:42:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:33 UTC)" (scheduled at 2022-11-28 08:42:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:42:33,352 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:42:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:07 UTC)" (scheduled at 2022-11-28 08:42:37.716126+00:00) securityworker stdout | 2022-11-28 08:42:37,737 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:42:37,795 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:42:37,795 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:42:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 08:42:39,496 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:42:39,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 08:42:39,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:39,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:42:39,546 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:42:39,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 08:42:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:52 UTC)" (scheduled at 2022-11-28 08:42:42.901291+00:00) notificationworker stdout | 2022-11-28 08:42:42,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:42:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:42:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:15 UTC)" (scheduled at 2022-11-28 08:42:45.911636+00:00) securityworker stdout | 2022-11-28 08:42:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:42:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:17 UTC)" (scheduled at 2022-11-28 08:42:47.016425+00:00) gcworker stdout | 2022-11-28 08:42:47,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:42:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:50 UTC)" (scheduled at 2022-11-28 08:42:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:42:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:42:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:51 UTC)" (scheduled at 2022-11-28 08:42:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:42:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:42:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:02 UTC)" (scheduled at 2022-11-28 08:42:52.901291+00:00) notificationworker stdout | 2022-11-28 08:42:52,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:42:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:23 UTC)" (scheduled at 2022-11-28 08:42:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:42:53,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:42:54,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:42:54,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:42:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:54,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:42:54,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:42:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:42:54,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.078) gunicorn-web stdout | 2022-11-28 08:42:54,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) securityscanningnotificationworker stdout | 2022-11-28 08:42:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:56 UTC)" (scheduled at 2022-11-28 08:42:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:42:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:42:57,517 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:57 UTC)" (scheduled at 2022-11-28 08:42:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:42:57,649 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:43:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:43:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:12 UTC)" (scheduled at 2022-11-28 08:43:02.901291+00:00) notificationworker stdout | 2022-11-28 08:43:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:43:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:03 UTC)" (scheduled at 2022-11-28 08:43:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:43:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:43:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:06 UTC)" (scheduled at 2022-11-28 08:43:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:43:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:43:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:37 UTC)" (scheduled at 2022-11-28 08:43:07.716126+00:00) securityworker stdout | 2022-11-28 08:43:07,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:43:07,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:43:07,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:43:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:43:09,485 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:43:09,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:43:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:43:09,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:43:09,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.057 118 0.056) gunicorn-web stdout | 2022-11-28 08:43:09,529 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:43:09,536 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) notificationworker stdout | 2022-11-28 08:43:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:22 UTC)" (scheduled at 2022-11-28 08:43:12.901291+00:00) notificationworker stdout | 2022-11-28 08:43:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:43:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:15 UTC)" (scheduled at 2022-11-28 08:43:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:43:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:43:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:45 UTC)" (scheduled at 2022-11-28 08:43:15.911636+00:00) securityworker stdout | 2022-11-28 08:43:15,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:43:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:47 UTC)" (scheduled at 2022-11-28 08:43:17.016425+00:00) gcworker stdout | 2022-11-28 08:43:17,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:43:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:32 UTC)" (scheduled at 2022-11-28 08:43:22.901291+00:00) notificationworker stdout | 2022-11-28 08:43:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:43:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:53 UTC)" (scheduled at 2022-11-28 08:43:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:43:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:43:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:43:24,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:43:24,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 08:43:24,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:43:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:43:24,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:43:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:43:24,557 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:43:24,598 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.127 118 0.127) notificationworker stdout | 2022-11-28 08:43:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:42 UTC)" (scheduled at 2022-11-28 08:43:32.901291+00:00) notificationworker stdout | 2022-11-28 08:43:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:43:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:33 UTC)" (scheduled at 2022-11-28 08:43:33.026570+00:00) notificationworker stdout | 2022-11-28 08:43:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:43:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:33 UTC)" (scheduled at 2022-11-28 08:43:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:43:33,359 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:43:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:07 UTC)" (scheduled at 2022-11-28 08:43:37.716126+00:00) securityworker stdout | 2022-11-28 08:43:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:43:37,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:43:37,796 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:43:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:48:38 UTC)" (scheduled at 2022-11-28 08:43:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:43:38,478 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:48:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 08:43:39,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:43:39,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:43:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:43:39,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:43:39,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:43:39,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:43:39,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:43:39,563 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.089) notificationworker stdout | 2022-11-28 08:43:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:52 UTC)" (scheduled at 2022-11-28 08:43:42.901291+00:00) notificationworker stdout | 2022-11-28 08:43:42,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:43:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:43:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:15 UTC)" (scheduled at 2022-11-28 08:43:45.911636+00:00) securityworker stdout | 2022-11-28 08:43:45,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:43:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:17 UTC)" (scheduled at 2022-11-28 08:43:47.016425+00:00) gcworker stdout | 2022-11-28 08:43:47,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:43:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:48:49 UTC)" (scheduled at 2022-11-28 08:43:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:43:49,481 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:48:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:43:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:50 UTC)" (scheduled at 2022-11-28 08:43:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:43:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:43:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:51 UTC)" (scheduled at 2022-11-28 08:43:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:43:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:43:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:02 UTC)" (scheduled at 2022-11-28 08:43:52.901291+00:00) notificationworker stdout | 2022-11-28 08:43:52,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:43:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:23 UTC)" (scheduled at 2022-11-28 08:43:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:43:53,139 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:43:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:43:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:43:54,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:43:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:43:54,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:43:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:43:54,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:43:54,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) securityscanningnotificationworker stdout | 2022-11-28 08:43:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:56 UTC)" (scheduled at 2022-11-28 08:43:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:43:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:43:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:57 UTC)" (scheduled at 2022-11-28 08:43:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:43:57,592 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:44:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:44:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:12 UTC)" (scheduled at 2022-11-28 08:44:02.901291+00:00) notificationworker stdout | 2022-11-28 08:44:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:44:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:03 UTC)" (scheduled at 2022-11-28 08:44:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:44:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:44:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:06 UTC)" (scheduled at 2022-11-28 08:44:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:44:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:44:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:37 UTC)" (scheduled at 2022-11-28 08:44:07.716126+00:00) securityworker stdout | 2022-11-28 08:44:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:44:07,780 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:44:07,781 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:44:09,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:44:09,497 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:44:09,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:09,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:09,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:44:09,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) gunicorn-web stdout | 2022-11-28 08:44:09,582 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 08:44:09,589 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:44:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:22 UTC)" (scheduled at 2022-11-28 08:44:12.901291+00:00) notificationworker stdout | 2022-11-28 08:44:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:44:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:15 UTC)" (scheduled at 2022-11-28 08:44:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:44:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:44:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:45 UTC)" (scheduled at 2022-11-28 08:44:15.911636+00:00) securityworker stdout | 2022-11-28 08:44:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:44:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:47 UTC)" (scheduled at 2022-11-28 08:44:17.016425+00:00) gcworker stdout | 2022-11-28 08:44:17,083 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:44:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:32 UTC)" (scheduled at 2022-11-28 08:44:22.901291+00:00) notificationworker stdout | 2022-11-28 08:44:22,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:44:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:53 UTC)" (scheduled at 2022-11-28 08:44:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:44:23,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:44:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:44:24,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:44:24,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:24,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:24,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:44:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:44:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.191 118 0.191) gunicorn-web stdout | 2022-11-28 08:44:24,664 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.205 118 0.205) gunicorn-web stdout | 2022-11-28 08:44:24,678 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:44:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:42 UTC)" (scheduled at 2022-11-28 08:44:32.901291+00:00) notificationworker stdout | 2022-11-28 08:44:32,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:44:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:33 UTC)" (scheduled at 2022-11-28 08:44:33.026570+00:00) notificationworker stdout | 2022-11-28 08:44:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:44:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:33 UTC)" (scheduled at 2022-11-28 08:44:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:44:33,380 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:44:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:07 UTC)" (scheduled at 2022-11-28 08:44:37.716126+00:00) securityworker stdout | 2022-11-28 08:44:37,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:44:37,775 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:44:37,776 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:44:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:49:38 UTC)" (scheduled at 2022-11-28 08:44:38.024004+00:00) notificationworker stdout | 2022-11-28 08:44:38,136 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:49:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:44:39,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) gunicorn-registry stdout | 2022-11-28 08:44:39,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:44:39,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:39,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:44:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:44:39,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:44:39,564 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:44:39,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 08:44:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:52 UTC)" (scheduled at 2022-11-28 08:44:42.901291+00:00) notificationworker stdout | 2022-11-28 08:44:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:44:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:44:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:15 UTC)" (scheduled at 2022-11-28 08:44:45.911636+00:00) securityworker stdout | 2022-11-28 08:44:45,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:44:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:17 UTC)" (scheduled at 2022-11-28 08:44:47.016425+00:00) gcworker stdout | 2022-11-28 08:44:47,095 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:44:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:50 UTC)" (scheduled at 2022-11-28 08:44:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:44:50,160 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:44:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:51 UTC)" (scheduled at 2022-11-28 08:44:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:44:51,778 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:44:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:02 UTC)" (scheduled at 2022-11-28 08:44:52.901291+00:00) notificationworker stdout | 2022-11-28 08:44:52,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:44:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:23 UTC)" (scheduled at 2022-11-28 08:44:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:44:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:44:54,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:44:54,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:54,492 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:44:54,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:44:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:44:54,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:44:54,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:44:54,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) securityscanningnotificationworker stdout | 2022-11-28 08:44:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:56 UTC)" (scheduled at 2022-11-28 08:44:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:44:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:44:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:57 UTC)" (scheduled at 2022-11-28 08:44:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:44:57,561 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:45:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:45:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:12 UTC)" (scheduled at 2022-11-28 08:45:02.901291+00:00) notificationworker stdout | 2022-11-28 08:45:02,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:45:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:03 UTC)" (scheduled at 2022-11-28 08:45:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:45:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:45:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:06 UTC)" (scheduled at 2022-11-28 08:45:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:45:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:45:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:37 UTC)" (scheduled at 2022-11-28 08:45:07.716126+00:00) securityworker stdout | 2022-11-28 08:45:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:45:07,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:45:07,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:45:09,490 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:45:09,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:09,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-registry stdout | 2022-11-28 08:45:09,506 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:09,513 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:09,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:45:09,549 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:45:09,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 08:45:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:22 UTC)" (scheduled at 2022-11-28 08:45:12.901291+00:00) notificationworker stdout | 2022-11-28 08:45:13,008 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:45:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:15 UTC)" (scheduled at 2022-11-28 08:45:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:45:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:45:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:45 UTC)" (scheduled at 2022-11-28 08:45:15.911636+00:00) securityworker stdout | 2022-11-28 08:45:15,993 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:45:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:47 UTC)" (scheduled at 2022-11-28 08:45:17.016425+00:00) gcworker stdout | 2022-11-28 08:45:17,082 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:45:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:32 UTC)" (scheduled at 2022-11-28 08:45:22.901291+00:00) notificationworker stdout | 2022-11-28 08:45:22,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:45:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:53 UTC)" (scheduled at 2022-11-28 08:45:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:45:23,215 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:45:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:45:24,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.007) gunicorn-registry stdout | 2022-11-28 08:45:24,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 08:45:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:45:24,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:45:24,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.001) gunicorn-web stdout | 2022-11-28 08:45:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:45:24,614 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.142) gunicorn-web stdout | 2022-11-28 08:45:24,629 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.155 118 0.155) notificationworker stdout | 2022-11-28 08:45:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:42 UTC)" (scheduled at 2022-11-28 08:45:32.901291+00:00) notificationworker stdout | 2022-11-28 08:45:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:33 UTC)" (scheduled at 2022-11-28 08:45:33.026570+00:00) notificationworker stdout | 2022-11-28 08:45:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:45:33,032 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:45:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:33 UTC)" (scheduled at 2022-11-28 08:45:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:45:33,365 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:45:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:07 UTC)" (scheduled at 2022-11-28 08:45:37.716126+00:00) securityworker stdout | 2022-11-28 08:45:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:45:37,821 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:45:37,822 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:45:39,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:45:39,497 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:45:39,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:39,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:45:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:45:39,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 08:45:39,598 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:45:39,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) securityscanningnotificationworker stdout | 2022-11-28 08:45:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:50:41 UTC)" (scheduled at 2022-11-28 08:45:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:45:41,203 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:50:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:45:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:52 UTC)" (scheduled at 2022-11-28 08:45:42.901291+00:00) notificationworker stdout | 2022-11-28 08:45:42,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:45:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:45:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:15 UTC)" (scheduled at 2022-11-28 08:45:45.911636+00:00) securityworker stdout | 2022-11-28 08:45:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:45:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:17 UTC)" (scheduled at 2022-11-28 08:45:47.016425+00:00) gcworker stdout | 2022-11-28 08:45:47,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:45:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:50:48 UTC)" (scheduled at 2022-11-28 08:45:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:45:48,120 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:50:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:45:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:50 UTC)" (scheduled at 2022-11-28 08:45:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:45:50,178 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:45:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:51 UTC)" (scheduled at 2022-11-28 08:45:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:45:51,805 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:45:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:02 UTC)" (scheduled at 2022-11-28 08:45:52.901291+00:00) notificationworker stdout | 2022-11-28 08:45:52,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:45:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:23 UTC)" (scheduled at 2022-11-28 08:45:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:45:53,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:45:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 08:45:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:45:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:54,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:45:54,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:45:54,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:45:54,569 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:45:54,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) securityscanningnotificationworker stdout | 2022-11-28 08:45:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:56 UTC)" (scheduled at 2022-11-28 08:45:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:45:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:45:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:57 UTC)" (scheduled at 2022-11-28 08:45:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:45:57,601 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:46:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:46:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:12 UTC)" (scheduled at 2022-11-28 08:46:02.901291+00:00) notificationworker stdout | 2022-11-28 08:46:02,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:46:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:03 UTC)" (scheduled at 2022-11-28 08:46:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:46:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:46:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:06 UTC)" (scheduled at 2022-11-28 08:46:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:46:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:46:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:37 UTC)" (scheduled at 2022-11-28 08:46:07.716126+00:00) securityworker stdout | 2022-11-28 08:46:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:46:07,785 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:46:07,786 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:46:09,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:46:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 08:46:09,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:09,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:09,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:09,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 08:46:09,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) notificationworker stdout | 2022-11-28 08:46:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:22 UTC)" (scheduled at 2022-11-28 08:46:12.901291+00:00) notificationworker stdout | 2022-11-28 08:46:12,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:46:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:15 UTC)" (scheduled at 2022-11-28 08:46:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:46:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:46:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:45 UTC)" (scheduled at 2022-11-28 08:46:15.911636+00:00) securityworker stdout | 2022-11-28 08:46:15,999 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:46:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:47 UTC)" (scheduled at 2022-11-28 08:46:17.016425+00:00) gcworker stdout | 2022-11-28 08:46:17,114 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:46:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:32 UTC)" (scheduled at 2022-11-28 08:46:22.901291+00:00) notificationworker stdout | 2022-11-28 08:46:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:46:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:53 UTC)" (scheduled at 2022-11-28 08:46:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:46:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:46:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:46:24,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:46:24,486 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:46:24,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:24,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:46:24,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:24,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:24,592 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.147 118 0.147) gunicorn-web stdout | 2022-11-28 08:46:24,621 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:46:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:42 UTC)" (scheduled at 2022-11-28 08:46:32.901291+00:00) notificationworker stdout | 2022-11-28 08:46:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:46:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:33 UTC)" (scheduled at 2022-11-28 08:46:33.026570+00:00) notificationworker stdout | 2022-11-28 08:46:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:46:33,325 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:33 UTC)" (scheduled at 2022-11-28 08:46:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:46:33,347 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:46:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:07 UTC)" (scheduled at 2022-11-28 08:46:37.716126+00:00) securityworker stdout | 2022-11-28 08:46:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:46:37,776 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:46:37,779 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:46:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:46:39,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:46:39,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:46:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:39,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:39,549 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:46:39,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) notificationworker stdout | 2022-11-28 08:46:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:52 UTC)" (scheduled at 2022-11-28 08:46:42.901291+00:00) notificationworker stdout | 2022-11-28 08:46:42,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:46:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:46:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:15 UTC)" (scheduled at 2022-11-28 08:46:45.911636+00:00) securityworker stdout | 2022-11-28 08:46:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:46:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:17 UTC)" (scheduled at 2022-11-28 08:46:47.016425+00:00) gcworker stdout | 2022-11-28 08:46:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:46:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:50 UTC)" (scheduled at 2022-11-28 08:46:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:46:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:46:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:51 UTC)" (scheduled at 2022-11-28 08:46:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:46:51,793 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:46:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:02 UTC)" (scheduled at 2022-11-28 08:46:52.901291+00:00) notificationworker stdout | 2022-11-28 08:46:52,989 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:46:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:23 UTC)" (scheduled at 2022-11-28 08:46:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:46:53,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:46:54,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:46:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:46:54,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:46:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:54,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:46:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:46:54,602 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) gunicorn-web stdout | 2022-11-28 08:46:54,603 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) securityscanningnotificationworker stdout | 2022-11-28 08:46:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:56 UTC)" (scheduled at 2022-11-28 08:46:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:46:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:46:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:57 UTC)" (scheduled at 2022-11-28 08:46:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:46:57,776 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:47:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:47:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:12 UTC)" (scheduled at 2022-11-28 08:47:02.901291+00:00) notificationworker stdout | 2022-11-28 08:47:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:47:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:03 UTC)" (scheduled at 2022-11-28 08:47:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:47:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:47:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:06 UTC)" (scheduled at 2022-11-28 08:47:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:47:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:47:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:37 UTC)" (scheduled at 2022-11-28 08:47:07.716126+00:00) securityworker stdout | 2022-11-28 08:47:07,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:47:07,795 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:47:07,796 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:47:09,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:47:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:47:09,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:09,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:47:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 08:47:09,536 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:47:09,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:47:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:22 UTC)" (scheduled at 2022-11-28 08:47:12.901291+00:00) notificationworker stdout | 2022-11-28 08:47:12,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:47:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:15 UTC)" (scheduled at 2022-11-28 08:47:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:47:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:47:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:45 UTC)" (scheduled at 2022-11-28 08:47:15.911636+00:00) securityworker stdout | 2022-11-28 08:47:15,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:47:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:47 UTC)" (scheduled at 2022-11-28 08:47:17.016425+00:00) gcworker stdout | 2022-11-28 08:47:17,120 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:47:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:32 UTC)" (scheduled at 2022-11-28 08:47:22.901291+00:00) notificationworker stdout | 2022-11-28 08:47:22,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:47:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:53 UTC)" (scheduled at 2022-11-28 08:47:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:47:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:47:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 08:47:24,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:47:24,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:47:24,491 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:47:24,492 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:24,493 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:47:24,493 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.147 118 0.147) gunicorn-web stdout | 2022-11-28 08:47:24,621 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.187 118 0.184) gunicorn-web stdout | 2022-11-28 08:47:24,659 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:47:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:42 UTC)" (scheduled at 2022-11-28 08:47:32.901291+00:00) notificationworker stdout | 2022-11-28 08:47:32,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:47:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:33 UTC)" (scheduled at 2022-11-28 08:47:33.026570+00:00) notificationworker stdout | 2022-11-28 08:47:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:47:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:33 UTC)" (scheduled at 2022-11-28 08:47:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:47:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:47:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:07 UTC)" (scheduled at 2022-11-28 08:47:37.716126+00:00) securityworker stdout | 2022-11-28 08:47:37,763 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:47:37,831 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:47:37,831 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:47:39,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:47:39,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:47:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:47:39,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:39,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:47:39,547 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:47:39,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:47:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:52 UTC)" (scheduled at 2022-11-28 08:47:42.901291+00:00) notificationworker stdout | 2022-11-28 08:47:43,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:47:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:47:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:15 UTC)" (scheduled at 2022-11-28 08:47:45.911636+00:00) securityworker stdout | 2022-11-28 08:47:45,981 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:47:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:17 UTC)" (scheduled at 2022-11-28 08:47:47.016425+00:00) gcworker stdout | 2022-11-28 08:47:47,098 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:47:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:50 UTC)" (scheduled at 2022-11-28 08:47:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:47:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:47:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:51 UTC)" (scheduled at 2022-11-28 08:47:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:47:51,793 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:47:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:02 UTC)" (scheduled at 2022-11-28 08:47:52.901291+00:00) notificationworker stdout | 2022-11-28 08:47:52,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:47:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:23 UTC)" (scheduled at 2022-11-28 08:47:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:47:53,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:47:54,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:47:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:47:54,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:47:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:47:54,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:47:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:47:54,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.076) gunicorn-web stdout | 2022-11-28 08:47:54,600 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) securityscanningnotificationworker stdout | 2022-11-28 08:47:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:56 UTC)" (scheduled at 2022-11-28 08:47:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:47:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:47:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:57 UTC)" (scheduled at 2022-11-28 08:47:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:47:57,574 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:48:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:48:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:12 UTC)" (scheduled at 2022-11-28 08:48:02.901291+00:00) notificationworker stdout | 2022-11-28 08:48:02,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:48:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:03 UTC)" (scheduled at 2022-11-28 08:48:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:48:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:48:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:06 UTC)" (scheduled at 2022-11-28 08:48:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:48:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:48:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:37 UTC)" (scheduled at 2022-11-28 08:48:07.716126+00:00) securityworker stdout | 2022-11-28 08:48:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:48:07,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:48:07,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:48:09,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:48:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.001) gunicorn-web stdout | 2022-11-28 08:48:09,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:09,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:48:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.055 118 0.055) gunicorn-web stdout | 2022-11-28 08:48:09,526 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:48:09,539 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 08:48:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:22 UTC)" (scheduled at 2022-11-28 08:48:12.901291+00:00) notificationworker stdout | 2022-11-28 08:48:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:48:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:15 UTC)" (scheduled at 2022-11-28 08:48:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:48:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:48:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:45 UTC)" (scheduled at 2022-11-28 08:48:15.911636+00:00) securityworker stdout | 2022-11-28 08:48:15,977 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:48:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:47 UTC)" (scheduled at 2022-11-28 08:48:17.016425+00:00) gcworker stdout | 2022-11-28 08:48:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:48:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:32 UTC)" (scheduled at 2022-11-28 08:48:22.901291+00:00) notificationworker stdout | 2022-11-28 08:48:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:48:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:53 UTC)" (scheduled at 2022-11-28 08:48:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:48:23,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:48:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:48:24,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:48:24,492 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:24,494 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:48:24,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 08:48:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.064) gunicorn-web stdout | 2022-11-28 08:48:24,536 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 08:48:24,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:48:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:42 UTC)" (scheduled at 2022-11-28 08:48:32.901291+00:00) notificationworker stdout | 2022-11-28 08:48:32,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:48:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:33 UTC)" (scheduled at 2022-11-28 08:48:33.026570+00:00) notificationworker stdout | 2022-11-28 08:48:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:48:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:33 UTC)" (scheduled at 2022-11-28 08:48:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:48:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:48:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:07 UTC)" (scheduled at 2022-11-28 08:48:37.716126+00:00) securityworker stdout | 2022-11-28 08:48:37,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:48:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:48:37,802 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:48:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:53:38 UTC)" (scheduled at 2022-11-28 08:48:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:48:38,499 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:53:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:48:39,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:48:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:39,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:48:39,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 08:48:39,530 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:48:39,530 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) notificationworker stdout | 2022-11-28 08:48:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:52 UTC)" (scheduled at 2022-11-28 08:48:42.901291+00:00) notificationworker stdout | 2022-11-28 08:48:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:48:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:48:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:15 UTC)" (scheduled at 2022-11-28 08:48:45.911636+00:00) securityworker stdout | 2022-11-28 08:48:46,017 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:48:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:17 UTC)" (scheduled at 2022-11-28 08:48:47.016425+00:00) gcworker stdout | 2022-11-28 08:48:47,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:48:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:53:49 UTC)" (scheduled at 2022-11-28 08:48:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:48:49,445 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:53:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:48:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:50 UTC)" (scheduled at 2022-11-28 08:48:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:48:50,172 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:48:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:51 UTC)" (scheduled at 2022-11-28 08:48:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:48:51,856 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:48:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:02 UTC)" (scheduled at 2022-11-28 08:48:52.901291+00:00) notificationworker stdout | 2022-11-28 08:48:53,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:48:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:23 UTC)" (scheduled at 2022-11-28 08:48:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:48:53,326 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:48:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:48:54,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:48:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:48:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:48:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:48:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 08:48:54,579 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.142 118 0.142) gunicorn-web stdout | 2022-11-28 08:48:54,614 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:48:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:56 UTC)" (scheduled at 2022-11-28 08:48:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:48:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:48:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:57 UTC)" (scheduled at 2022-11-28 08:48:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:48:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:49:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:49:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:12 UTC)" (scheduled at 2022-11-28 08:49:02.901291+00:00) notificationworker stdout | 2022-11-28 08:49:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:49:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:03 UTC)" (scheduled at 2022-11-28 08:49:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:49:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:49:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:06 UTC)" (scheduled at 2022-11-28 08:49:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:49:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:49:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:37 UTC)" (scheduled at 2022-11-28 08:49:07.716126+00:00) securityworker stdout | 2022-11-28 08:49:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:49:07,797 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:49:07,798 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:49:09,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:49:09,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:49:09,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:49:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:49:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:49:09,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:49:09,540 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:49:09,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) notificationworker stdout | 2022-11-28 08:49:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:22 UTC)" (scheduled at 2022-11-28 08:49:12.901291+00:00) notificationworker stdout | 2022-11-28 08:49:12,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:49:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:15 UTC)" (scheduled at 2022-11-28 08:49:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:49:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:49:15,918 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:45 UTC)" (scheduled at 2022-11-28 08:49:15.911636+00:00) securityworker stdout | 2022-11-28 08:49:15,998 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:49:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:47 UTC)" (scheduled at 2022-11-28 08:49:17.016425+00:00) gcworker stdout | 2022-11-28 08:49:17,060 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:49:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:32 UTC)" (scheduled at 2022-11-28 08:49:22.901291+00:00) notificationworker stdout | 2022-11-28 08:49:22,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:49:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:53 UTC)" (scheduled at 2022-11-28 08:49:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:49:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:49:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:49:24,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:49:24,501 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 08:49:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:49:24,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:49:24,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:49:24,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 08:49:24,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:49:24,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:49:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:42 UTC)" (scheduled at 2022-11-28 08:49:32.901291+00:00) notificationworker stdout | 2022-11-28 08:49:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:49:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:33 UTC)" (scheduled at 2022-11-28 08:49:33.026570+00:00) notificationworker stdout | 2022-11-28 08:49:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:49:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:33 UTC)" (scheduled at 2022-11-28 08:49:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:49:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:49:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:07 UTC)" (scheduled at 2022-11-28 08:49:37.716126+00:00) securityworker stdout | 2022-11-28 08:49:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:49:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:49:37,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:49:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:54:38 UTC)" (scheduled at 2022-11-28 08:49:38.024004+00:00) notificationworker stdout | 2022-11-28 08:49:38,077 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:54:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 08:49:39,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:49:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:49:39,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:49:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:49:39,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:49:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:49:39,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:49:39,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 08:49:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:52 UTC)" (scheduled at 2022-11-28 08:49:42.901291+00:00) notificationworker stdout | 2022-11-28 08:49:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:49:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:49:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:15 UTC)" (scheduled at 2022-11-28 08:49:45.911636+00:00) securityworker stdout | 2022-11-28 08:49:45,971 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:49:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:17 UTC)" (scheduled at 2022-11-28 08:49:47.016425+00:00) gcworker stdout | 2022-11-28 08:49:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:49:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:50 UTC)" (scheduled at 2022-11-28 08:49:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:49:50,177 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:49:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:51 UTC)" (scheduled at 2022-11-28 08:49:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:49:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:49:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:02 UTC)" (scheduled at 2022-11-28 08:49:52.901291+00:00) notificationworker stdout | 2022-11-28 08:49:52,990 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:49:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:23 UTC)" (scheduled at 2022-11-28 08:49:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:49:53,201 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:49:54,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:49:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:49:54,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:49:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:49:54,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:49:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:49:54,594 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.146 118 0.143) gunicorn-web stdout | 2022-11-28 08:49:54,618 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:49:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:56 UTC)" (scheduled at 2022-11-28 08:49:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:49:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:49:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:57 UTC)" (scheduled at 2022-11-28 08:49:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:49:57,687 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:50:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:50:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:12 UTC)" (scheduled at 2022-11-28 08:50:02.901291+00:00) notificationworker stdout | 2022-11-28 08:50:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:50:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:03 UTC)" (scheduled at 2022-11-28 08:50:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:50:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:50:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:06 UTC)" (scheduled at 2022-11-28 08:50:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:50:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:50:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:37 UTC)" (scheduled at 2022-11-28 08:50:07.716126+00:00) securityworker stdout | 2022-11-28 08:50:07,743 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:50:07,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:50:07,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:50:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:50:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:50:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:09,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:50:09,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:50:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:50:09,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:50:09,539 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:50:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:22 UTC)" (scheduled at 2022-11-28 08:50:12.901291+00:00) notificationworker stdout | 2022-11-28 08:50:12,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:50:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:15 UTC)" (scheduled at 2022-11-28 08:50:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:50:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:50:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:45 UTC)" (scheduled at 2022-11-28 08:50:15.911636+00:00) securityworker stdout | 2022-11-28 08:50:15,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:50:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:47 UTC)" (scheduled at 2022-11-28 08:50:17.016425+00:00) gcworker stdout | 2022-11-28 08:50:17,114 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:50:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:32 UTC)" (scheduled at 2022-11-28 08:50:22.901291+00:00) notificationworker stdout | 2022-11-28 08:50:22,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:50:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:53 UTC)" (scheduled at 2022-11-28 08:50:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:50:23,185 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:50:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:50:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:50:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:50:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:50:24,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:50:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:50:24,589 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:50:24,589 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) notificationworker stdout | 2022-11-28 08:50:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:42 UTC)" (scheduled at 2022-11-28 08:50:32.901291+00:00) notificationworker stdout | 2022-11-28 08:50:32,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:50:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:33 UTC)" (scheduled at 2022-11-28 08:50:33.026570+00:00) notificationworker stdout | 2022-11-28 08:50:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:50:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:33 UTC)" (scheduled at 2022-11-28 08:50:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:50:33,355 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:50:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:07 UTC)" (scheduled at 2022-11-28 08:50:37.716126+00:00) securityworker stdout | 2022-11-28 08:50:37,750 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:50:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:50:37,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:50:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:50:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:50:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:39,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:50:39,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:50:39,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 08:50:39,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:50:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:55:41 UTC)" (scheduled at 2022-11-28 08:50:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:50:41,200 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:55:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:50:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:52 UTC)" (scheduled at 2022-11-28 08:50:42.901291+00:00) notificationworker stdout | 2022-11-28 08:50:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:50:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:50:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:15 UTC)" (scheduled at 2022-11-28 08:50:45.911636+00:00) securityworker stdout | 2022-11-28 08:50:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:50:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:17 UTC)" (scheduled at 2022-11-28 08:50:47.016425+00:00) gcworker stdout | 2022-11-28 08:50:47,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:50:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:55:48 UTC)" (scheduled at 2022-11-28 08:50:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:50:48,070 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:55:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:50:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:50 UTC)" (scheduled at 2022-11-28 08:50:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:50:50,174 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:50:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:51 UTC)" (scheduled at 2022-11-28 08:50:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:50:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:50:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:02 UTC)" (scheduled at 2022-11-28 08:50:52.901291+00:00) notificationworker stdout | 2022-11-28 08:50:52,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:50:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:23 UTC)" (scheduled at 2022-11-28 08:50:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:50:53,139 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:50:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:50:54,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:54,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:50:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:50:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:50:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:50:54,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 08:50:54,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:50:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:56 UTC)" (scheduled at 2022-11-28 08:50:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:50:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:50:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:57 UTC)" (scheduled at 2022-11-28 08:50:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:50:57,557 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:51:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:51:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:12 UTC)" (scheduled at 2022-11-28 08:51:02.901291+00:00) notificationworker stdout | 2022-11-28 08:51:02,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:51:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:03 UTC)" (scheduled at 2022-11-28 08:51:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:51:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:51:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:06 UTC)" (scheduled at 2022-11-28 08:51:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:51:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:51:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:37 UTC)" (scheduled at 2022-11-28 08:51:07.716126+00:00) securityworker stdout | 2022-11-28 08:51:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:51:07,783 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:51:07,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:51:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:51:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 08:51:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:51:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:09,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 08:51:09,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 08:51:09,586 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:51:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:22 UTC)" (scheduled at 2022-11-28 08:51:12.901291+00:00) notificationworker stdout | 2022-11-28 08:51:12,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:51:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:15 UTC)" (scheduled at 2022-11-28 08:51:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:51:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:51:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:45 UTC)" (scheduled at 2022-11-28 08:51:15.911636+00:00) securityworker stdout | 2022-11-28 08:51:15,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:51:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:47 UTC)" (scheduled at 2022-11-28 08:51:17.016425+00:00) gcworker stdout | 2022-11-28 08:51:17,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:51:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:32 UTC)" (scheduled at 2022-11-28 08:51:22.901291+00:00) notificationworker stdout | 2022-11-28 08:51:22,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:51:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:53 UTC)" (scheduled at 2022-11-28 08:51:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:51:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:51:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:51:24,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:51:24,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:51:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:51:24,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:51:24,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 08:51:24,564 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:51:24,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 08:51:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:42 UTC)" (scheduled at 2022-11-28 08:51:32.901291+00:00) notificationworker stdout | 2022-11-28 08:51:32,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:51:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:33 UTC)" (scheduled at 2022-11-28 08:51:33.026570+00:00) notificationworker stdout | 2022-11-28 08:51:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:51:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:33 UTC)" (scheduled at 2022-11-28 08:51:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:51:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:51:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:07 UTC)" (scheduled at 2022-11-28 08:51:37.716126+00:00) securityworker stdout | 2022-11-28 08:51:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:51:37,794 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:51:37,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:51:39,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:51:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:51:39,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:39,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:51:39,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:51:39,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 08:51:39,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:51:39,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) notificationworker stdout | 2022-11-28 08:51:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:52 UTC)" (scheduled at 2022-11-28 08:51:42.901291+00:00) notificationworker stdout | 2022-11-28 08:51:42,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:51:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:51:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:15 UTC)" (scheduled at 2022-11-28 08:51:45.911636+00:00) securityworker stdout | 2022-11-28 08:51:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:51:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:17 UTC)" (scheduled at 2022-11-28 08:51:47.016425+00:00) gcworker stdout | 2022-11-28 08:51:47,058 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:51:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:50 UTC)" (scheduled at 2022-11-28 08:51:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:51:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:51:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:51 UTC)" (scheduled at 2022-11-28 08:51:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:51:51,771 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:51:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:02 UTC)" (scheduled at 2022-11-28 08:51:52.901291+00:00) notificationworker stdout | 2022-11-28 08:51:52,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:51:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:23 UTC)" (scheduled at 2022-11-28 08:51:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:51:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:51:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:51:54,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) gunicorn-registry stdout | 2022-11-28 08:51:54,502 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:51:54,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:51:54,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:51:54,545 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 08:51:54,557 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:51:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:56 UTC)" (scheduled at 2022-11-28 08:51:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:51:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:51:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:57 UTC)" (scheduled at 2022-11-28 08:51:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:51:57,597 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:52:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:52:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:12 UTC)" (scheduled at 2022-11-28 08:52:02.901291+00:00) notificationworker stdout | 2022-11-28 08:52:02,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:52:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:03 UTC)" (scheduled at 2022-11-28 08:52:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:52:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:52:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:06 UTC)" (scheduled at 2022-11-28 08:52:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:52:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:52:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:37 UTC)" (scheduled at 2022-11-28 08:52:07.716126+00:00) securityworker stdout | 2022-11-28 08:52:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:52:07,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:52:07,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:52:09,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:52:09,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:52:09,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:52:09,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:09,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:52:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:52:09,566 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:52:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:22 UTC)" (scheduled at 2022-11-28 08:52:12.901291+00:00) notificationworker stdout | 2022-11-28 08:52:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:52:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:15 UTC)" (scheduled at 2022-11-28 08:52:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:52:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:52:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:45 UTC)" (scheduled at 2022-11-28 08:52:15.911636+00:00) securityworker stdout | 2022-11-28 08:52:15,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:52:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:47 UTC)" (scheduled at 2022-11-28 08:52:17.016425+00:00) gcworker stdout | 2022-11-28 08:52:17,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:52:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:32 UTC)" (scheduled at 2022-11-28 08:52:22.901291+00:00) notificationworker stdout | 2022-11-28 08:52:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:52:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:53 UTC)" (scheduled at 2022-11-28 08:52:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:52:23,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:52:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.007) gunicorn-registry stdout | 2022-11-28 08:52:24,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:52:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:52:24,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:24,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:52:24,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:52:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:52:24,593 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.121 118 0.121) gunicorn-web stdout | 2022-11-28 08:52:24,606 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) notificationworker stdout | 2022-11-28 08:52:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:42 UTC)" (scheduled at 2022-11-28 08:52:32.901291+00:00) notificationworker stdout | 2022-11-28 08:52:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:52:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:33 UTC)" (scheduled at 2022-11-28 08:52:33.026570+00:00) notificationworker stdout | 2022-11-28 08:52:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:52:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:33 UTC)" (scheduled at 2022-11-28 08:52:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:52:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:52:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:07 UTC)" (scheduled at 2022-11-28 08:52:37.716126+00:00) securityworker stdout | 2022-11-28 08:52:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:52:37,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:52:37,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 08:52:39,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 08:52:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:52:39,508 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:52:39,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:39,518 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:52:39,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 08:52:39,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:52:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:52 UTC)" (scheduled at 2022-11-28 08:52:42.901291+00:00) notificationworker stdout | 2022-11-28 08:52:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:52:52 UTC)" executed successfully servicekey stdout | 2022-11-28 08:52:44,409 [95] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 09:47:44 UTC)" (scheduled at 2022-11-28 08:52:44.408575+00:00) servicekey stdout | 2022-11-28 08:52:44,441 [95] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 09:47:44 UTC)" executed successfully securityworker stdout | 2022-11-28 08:52:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:15 UTC)" (scheduled at 2022-11-28 08:52:45.911636+00:00) securityworker stdout | 2022-11-28 08:52:45,963 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:52:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:17 UTC)" (scheduled at 2022-11-28 08:52:47.016425+00:00) gcworker stdout | 2022-11-28 08:52:47,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:52:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:50 UTC)" (scheduled at 2022-11-28 08:52:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:52:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:52:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:51 UTC)" (scheduled at 2022-11-28 08:52:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:52:51,794 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:52:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:02 UTC)" (scheduled at 2022-11-28 08:52:52.901291+00:00) notificationworker stdout | 2022-11-28 08:52:52,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:52:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:23 UTC)" (scheduled at 2022-11-28 08:52:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:52:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:52:54,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:52:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:52:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:52:54,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:52:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 08:52:54,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:52:54,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) securityscanningnotificationworker stdout | 2022-11-28 08:52:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:56 UTC)" (scheduled at 2022-11-28 08:52:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:52:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:52:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:57 UTC)" (scheduled at 2022-11-28 08:52:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:52:57,561 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:53:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:53:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:12 UTC)" (scheduled at 2022-11-28 08:53:02.901291+00:00) notificationworker stdout | 2022-11-28 08:53:02,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:53:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:03 UTC)" (scheduled at 2022-11-28 08:53:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:53:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:53:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:06 UTC)" (scheduled at 2022-11-28 08:53:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:53:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:53:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:37 UTC)" (scheduled at 2022-11-28 08:53:07.716126+00:00) securityworker stdout | 2022-11-28 08:53:07,783 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:53:07,847 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:53:07,848 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:53:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:53:09,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:53:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:09,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:53:09,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:53:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 08:53:09,561 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) gunicorn-web stdout | 2022-11-28 08:53:09,573 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:53:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:22 UTC)" (scheduled at 2022-11-28 08:53:12.901291+00:00) notificationworker stdout | 2022-11-28 08:53:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:53:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:15 UTC)" (scheduled at 2022-11-28 08:53:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:53:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:53:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:45 UTC)" (scheduled at 2022-11-28 08:53:15.911636+00:00) securityworker stdout | 2022-11-28 08:53:16,019 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:53:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:47 UTC)" (scheduled at 2022-11-28 08:53:17.016425+00:00) gcworker stdout | 2022-11-28 08:53:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:53:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:32 UTC)" (scheduled at 2022-11-28 08:53:22.901291+00:00) notificationworker stdout | 2022-11-28 08:53:22,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:53:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:53 UTC)" (scheduled at 2022-11-28 08:53:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:53:23,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:53:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:53:24,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 08:53:24,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:53:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:53:24,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:24,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 08:53:24,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.092) gunicorn-web stdout | 2022-11-28 08:53:24,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:53:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:42 UTC)" (scheduled at 2022-11-28 08:53:32.901291+00:00) notificationworker stdout | 2022-11-28 08:53:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:53:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:33 UTC)" (scheduled at 2022-11-28 08:53:33.026570+00:00) notificationworker stdout | 2022-11-28 08:53:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:53:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:33 UTC)" (scheduled at 2022-11-28 08:53:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:53:33,355 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:53:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:07 UTC)" (scheduled at 2022-11-28 08:53:37.716126+00:00) securityworker stdout | 2022-11-28 08:53:37,754 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:53:37,950 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:53:37,951 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:53:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:58:38 UTC)" (scheduled at 2022-11-28 08:53:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:53:38,522 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:58:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:53:39,482 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:53:39,491 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:39,493 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.019 162 0.020) gunicorn-registry stdout | 2022-11-28 08:53:39,499 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:53:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:39,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 08:53:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 08:53:39,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:53:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:52 UTC)" (scheduled at 2022-11-28 08:53:42.901291+00:00) notificationworker stdout | 2022-11-28 08:53:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:53:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:53:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:15 UTC)" (scheduled at 2022-11-28 08:53:45.911636+00:00) securityworker stdout | 2022-11-28 08:53:46,016 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:53:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:17 UTC)" (scheduled at 2022-11-28 08:53:47.016425+00:00) gcworker stdout | 2022-11-28 08:53:47,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:53:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:58:49 UTC)" (scheduled at 2022-11-28 08:53:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:53:49,459 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:58:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:53:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:50 UTC)" (scheduled at 2022-11-28 08:53:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:53:50,203 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:53:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:51 UTC)" (scheduled at 2022-11-28 08:53:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:53:51,796 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:53:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:02 UTC)" (scheduled at 2022-11-28 08:53:52.901291+00:00) notificationworker stdout | 2022-11-28 08:53:52,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:53:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:23 UTC)" (scheduled at 2022-11-28 08:53:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:53:53,168 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:53:54,483 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 08:53:54,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:53:54,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:53:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:53:54,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.139 118 0.139) gunicorn-web stdout | 2022-11-28 08:53:54,610 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:53:54,632 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) securityscanningnotificationworker stdout | 2022-11-28 08:53:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:56 UTC)" (scheduled at 2022-11-28 08:53:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:53:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:53:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:57 UTC)" (scheduled at 2022-11-28 08:53:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:53:57,617 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:54:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:54:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:12 UTC)" (scheduled at 2022-11-28 08:54:02.901291+00:00) notificationworker stdout | 2022-11-28 08:54:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:54:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:03 UTC)" (scheduled at 2022-11-28 08:54:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:54:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:54:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:06 UTC)" (scheduled at 2022-11-28 08:54:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:54:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:54:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:37 UTC)" (scheduled at 2022-11-28 08:54:07.716126+00:00) securityworker stdout | 2022-11-28 08:54:07,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:54:07,851 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:54:07,852 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:54:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:54:09,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 08:54:09,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:54:09,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:54:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:54:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 08:54:09,579 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 08:54:09,588 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:54:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:22 UTC)" (scheduled at 2022-11-28 08:54:12.901291+00:00) notificationworker stdout | 2022-11-28 08:54:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:54:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:15 UTC)" (scheduled at 2022-11-28 08:54:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:54:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:54:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:45 UTC)" (scheduled at 2022-11-28 08:54:15.911636+00:00) securityworker stdout | 2022-11-28 08:54:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:54:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:47 UTC)" (scheduled at 2022-11-28 08:54:17.016425+00:00) gcworker stdout | 2022-11-28 08:54:17,047 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:54:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:32 UTC)" (scheduled at 2022-11-28 08:54:22.901291+00:00) notificationworker stdout | 2022-11-28 08:54:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:54:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:53 UTC)" (scheduled at 2022-11-28 08:54:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:54:23,178 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:54:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:54:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:54:24,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:54:24,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:54:24,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:54:24,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:54:24,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:54:24,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 08:54:24,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:54:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:42 UTC)" (scheduled at 2022-11-28 08:54:32.901291+00:00) notificationworker stdout | 2022-11-28 08:54:32,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:54:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:33 UTC)" (scheduled at 2022-11-28 08:54:33.026570+00:00) notificationworker stdout | 2022-11-28 08:54:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:54:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:33 UTC)" (scheduled at 2022-11-28 08:54:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:54:33,368 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:54:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:07 UTC)" (scheduled at 2022-11-28 08:54:37.716126+00:00) securityworker stdout | 2022-11-28 08:54:37,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:54:37,791 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:54:37,791 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:54:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:59:38 UTC)" (scheduled at 2022-11-28 08:54:38.024004+00:00) notificationworker stdout | 2022-11-28 08:54:38,078 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 08:59:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:54:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:54:39,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:54:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:54:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:54:39,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:54:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 08:54:39,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:54:39,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) notificationworker stdout | 2022-11-28 08:54:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:52 UTC)" (scheduled at 2022-11-28 08:54:42.901291+00:00) notificationworker stdout | 2022-11-28 08:54:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:54:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:54:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:15 UTC)" (scheduled at 2022-11-28 08:54:45.911636+00:00) securityworker stdout | 2022-11-28 08:54:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:54:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:17 UTC)" (scheduled at 2022-11-28 08:54:47.016425+00:00) gcworker stdout | 2022-11-28 08:54:47,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:54:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:50 UTC)" (scheduled at 2022-11-28 08:54:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:54:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:54:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:51 UTC)" (scheduled at 2022-11-28 08:54:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:54:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:54:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:02 UTC)" (scheduled at 2022-11-28 08:54:52.901291+00:00) notificationworker stdout | 2022-11-28 08:54:52,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:54:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:23 UTC)" (scheduled at 2022-11-28 08:54:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:54:53,172 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:54:54,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 08:54:54,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:54:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:54:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:54:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:54:54,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:54:54,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:54:54,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) securityscanningnotificationworker stdout | 2022-11-28 08:54:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:56 UTC)" (scheduled at 2022-11-28 08:54:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:54:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:54:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:57 UTC)" (scheduled at 2022-11-28 08:54:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:54:57,559 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:55:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:55:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:12 UTC)" (scheduled at 2022-11-28 08:55:02.901291+00:00) notificationworker stdout | 2022-11-28 08:55:02,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:55:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:03 UTC)" (scheduled at 2022-11-28 08:55:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:55:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:55:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:06 UTC)" (scheduled at 2022-11-28 08:55:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:55:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:55:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:37 UTC)" (scheduled at 2022-11-28 08:55:07.716126+00:00) securityworker stdout | 2022-11-28 08:55:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:55:07,765 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:55:07,766 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:55:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 08:55:09,495 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:09,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:09,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:55:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:55:09,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) gunicorn-web stdout | 2022-11-28 08:55:09,533 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 08:55:09,544 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:55:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:22 UTC)" (scheduled at 2022-11-28 08:55:12.901291+00:00) notificationworker stdout | 2022-11-28 08:55:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:55:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:15 UTC)" (scheduled at 2022-11-28 08:55:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:55:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:55:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:45 UTC)" (scheduled at 2022-11-28 08:55:15.911636+00:00) securityworker stdout | 2022-11-28 08:55:15,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:55:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:47 UTC)" (scheduled at 2022-11-28 08:55:17.016425+00:00) gcworker stdout | 2022-11-28 08:55:17,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:55:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:32 UTC)" (scheduled at 2022-11-28 08:55:22.901291+00:00) notificationworker stdout | 2022-11-28 08:55:22,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:55:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:53 UTC)" (scheduled at 2022-11-28 08:55:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:55:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:55:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:55:24,507 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:55:24,508 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:55:24,525 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:55:24,525 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 08:55:24,540 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:24,547 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:55:24,561 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 08:55:24,597 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:55:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:42 UTC)" (scheduled at 2022-11-28 08:55:32.901291+00:00) notificationworker stdout | 2022-11-28 08:55:32,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:55:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:33 UTC)" (scheduled at 2022-11-28 08:55:33.026570+00:00) notificationworker stdout | 2022-11-28 08:55:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:55:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:33 UTC)" (scheduled at 2022-11-28 08:55:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:55:33,350 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:55:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:07 UTC)" (scheduled at 2022-11-28 08:55:37.716126+00:00) securityworker stdout | 2022-11-28 08:55:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:55:37,819 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:55:37,820 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:55:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:55:39,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:55:39,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:55:39,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:39,519 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:55:39,519 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:55:39,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 08:55:39,585 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) securityscanningnotificationworker stdout | 2022-11-28 08:55:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:00:41 UTC)" (scheduled at 2022-11-28 08:55:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:55:41,197 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:00:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:55:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:52 UTC)" (scheduled at 2022-11-28 08:55:42.901291+00:00) notificationworker stdout | 2022-11-28 08:55:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:55:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:55:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:15 UTC)" (scheduled at 2022-11-28 08:55:45.911636+00:00) securityworker stdout | 2022-11-28 08:55:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:55:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:17 UTC)" (scheduled at 2022-11-28 08:55:47.016425+00:00) gcworker stdout | 2022-11-28 08:55:47,091 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:55:48,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:00:48 UTC)" (scheduled at 2022-11-28 08:55:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 08:55:48,100 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:00:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:55:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:50 UTC)" (scheduled at 2022-11-28 08:55:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:55:50,160 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:55:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:51 UTC)" (scheduled at 2022-11-28 08:55:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:55:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:55:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:02 UTC)" (scheduled at 2022-11-28 08:55:52.901291+00:00) notificationworker stdout | 2022-11-28 08:55:52,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:55:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:23 UTC)" (scheduled at 2022-11-28 08:55:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:55:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:55:54,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:55:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:55:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:55:54,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:55:54,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 08:55:54,555 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:55:54,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:55:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:56 UTC)" (scheduled at 2022-11-28 08:55:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:55:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:55:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:57 UTC)" (scheduled at 2022-11-28 08:55:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:55:57,675 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:56:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:56:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:12 UTC)" (scheduled at 2022-11-28 08:56:02.901291+00:00) notificationworker stdout | 2022-11-28 08:56:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:56:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:03 UTC)" (scheduled at 2022-11-28 08:56:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:56:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:56:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:06 UTC)" (scheduled at 2022-11-28 08:56:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:56:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:56:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:37 UTC)" (scheduled at 2022-11-28 08:56:07.716126+00:00) securityworker stdout | 2022-11-28 08:56:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:56:07,769 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:56:07,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:56:09,481 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:56:09,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:56:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 08:56:09,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:56:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:56:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 08:56:09,529 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) gunicorn-web stdout | 2022-11-28 08:56:09,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:56:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:22 UTC)" (scheduled at 2022-11-28 08:56:12.901291+00:00) notificationworker stdout | 2022-11-28 08:56:12,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:56:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:15 UTC)" (scheduled at 2022-11-28 08:56:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:56:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:56:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:45 UTC)" (scheduled at 2022-11-28 08:56:15.911636+00:00) securityworker stdout | 2022-11-28 08:56:15,967 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:56:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:47 UTC)" (scheduled at 2022-11-28 08:56:17.016425+00:00) gcworker stdout | 2022-11-28 08:56:17,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:56:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:32 UTC)" (scheduled at 2022-11-28 08:56:22.901291+00:00) notificationworker stdout | 2022-11-28 08:56:22,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:56:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:53 UTC)" (scheduled at 2022-11-28 08:56:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:56:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:56:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:56:24,488 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:56:24,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:56:24,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:56:24,495 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 08:56:24,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:56:24,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 08:56:24,557 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:56:24,557 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) notificationworker stdout | 2022-11-28 08:56:32,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:42 UTC)" (scheduled at 2022-11-28 08:56:32.901291+00:00) notificationworker stdout | 2022-11-28 08:56:32,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:56:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:33 UTC)" (scheduled at 2022-11-28 08:56:33.026570+00:00) notificationworker stdout | 2022-11-28 08:56:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:56:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:33 UTC)" (scheduled at 2022-11-28 08:56:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:56:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:33 UTC)" executed successfully repositoryactioncounter stdout | 2022-11-28 08:56:35,836 [82] [INFO] [apscheduler.executors.default] Running job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2022-11-28 12:56:35 UTC)" (scheduled at 2022-11-28 08:56:35.832454+00:00) repositoryactioncounter stdout | 2022-11-28 08:56:35,926 [82] [INFO] [apscheduler.executors.default] Job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2022-11-28 12:56:35 UTC)" executed successfully securityworker stdout | 2022-11-28 08:56:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:07 UTC)" (scheduled at 2022-11-28 08:56:37.716126+00:00) securityworker stdout | 2022-11-28 08:56:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:56:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:56:37,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:56:39,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:56:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 08:56:39,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:56:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:56:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:56:39,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:56:39,547 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 08:56:39,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:56:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:52 UTC)" (scheduled at 2022-11-28 08:56:42.901291+00:00) notificationworker stdout | 2022-11-28 08:56:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:56:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:56:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:15 UTC)" (scheduled at 2022-11-28 08:56:45.911636+00:00) securityworker stdout | 2022-11-28 08:56:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:56:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:17 UTC)" (scheduled at 2022-11-28 08:56:47.016425+00:00) gcworker stdout | 2022-11-28 08:56:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:56:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:50 UTC)" (scheduled at 2022-11-28 08:56:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:56:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:56:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:51 UTC)" (scheduled at 2022-11-28 08:56:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:56:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:56:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:02 UTC)" (scheduled at 2022-11-28 08:56:52.901291+00:00) notificationworker stdout | 2022-11-28 08:56:52,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:56:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:23 UTC)" (scheduled at 2022-11-28 08:56:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:56:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 08:56:54,494 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.024 162 0.024) gunicorn-web stdout | 2022-11-28 08:56:54,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 08:56:54,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 08:56:54,509 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:56:54,520 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:56:54,523 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 08:56:54,550 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:56:54,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) securityscanningnotificationworker stdout | 2022-11-28 08:56:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:56 UTC)" (scheduled at 2022-11-28 08:56:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:56:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:56:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:57 UTC)" (scheduled at 2022-11-28 08:56:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:56:57,550 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:57:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:57:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:12 UTC)" (scheduled at 2022-11-28 08:57:02.901291+00:00) notificationworker stdout | 2022-11-28 08:57:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:57:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:03 UTC)" (scheduled at 2022-11-28 08:57:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:57:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:57:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:06 UTC)" (scheduled at 2022-11-28 08:57:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:57:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:57:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:37 UTC)" (scheduled at 2022-11-28 08:57:07.716126+00:00) securityworker stdout | 2022-11-28 08:57:07,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:57:07,762 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:57:07,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 08:57:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:57:09,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:57:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:57:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 08:57:09,539 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 08:57:09,543 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:57:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:22 UTC)" (scheduled at 2022-11-28 08:57:12.901291+00:00) notificationworker stdout | 2022-11-28 08:57:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:57:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:15 UTC)" (scheduled at 2022-11-28 08:57:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:57:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:57:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:45 UTC)" (scheduled at 2022-11-28 08:57:15.911636+00:00) securityworker stdout | 2022-11-28 08:57:15,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:57:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:47 UTC)" (scheduled at 2022-11-28 08:57:17.016425+00:00) gcworker stdout | 2022-11-28 08:57:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:57:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:32 UTC)" (scheduled at 2022-11-28 08:57:22.901291+00:00) notificationworker stdout | 2022-11-28 08:57:22,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:57:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:53 UTC)" (scheduled at 2022-11-28 08:57:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:57:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:57:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 08:57:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 08:57:24,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:57:24,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:57:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:57:24,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 08:57:24,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) gunicorn-web stdout | 2022-11-28 08:57:24,577 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:57:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:42 UTC)" (scheduled at 2022-11-28 08:57:32.901291+00:00) notificationworker stdout | 2022-11-28 08:57:32,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:57:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:33 UTC)" (scheduled at 2022-11-28 08:57:33.026570+00:00) notificationworker stdout | 2022-11-28 08:57:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:57:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:33 UTC)" (scheduled at 2022-11-28 08:57:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:57:33,622 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:57:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:07 UTC)" (scheduled at 2022-11-28 08:57:37.716126+00:00) securityworker stdout | 2022-11-28 08:57:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:57:37,795 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:57:37,795 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:57:39,482 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:57:39,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:57:39,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:39,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:57:39,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:57:39,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:57:39,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:57:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:52 UTC)" (scheduled at 2022-11-28 08:57:42.901291+00:00) notificationworker stdout | 2022-11-28 08:57:42,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:57:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:57:45,916 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:15 UTC)" (scheduled at 2022-11-28 08:57:45.911636+00:00) securityworker stdout | 2022-11-28 08:57:45,990 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:57:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:17 UTC)" (scheduled at 2022-11-28 08:57:47.016425+00:00) gcworker stdout | 2022-11-28 08:57:47,095 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:57:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:50 UTC)" (scheduled at 2022-11-28 08:57:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:57:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:57:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:51 UTC)" (scheduled at 2022-11-28 08:57:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:57:51,794 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:57:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:02 UTC)" (scheduled at 2022-11-28 08:57:52.901291+00:00) notificationworker stdout | 2022-11-28 08:57:52,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:57:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:23 UTC)" (scheduled at 2022-11-28 08:57:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:57:53,182 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 08:57:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:57:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:57:54,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:57:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:57:54,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 08:57:54,543 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:57:54,544 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) securityscanningnotificationworker stdout | 2022-11-28 08:57:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:56 UTC)" (scheduled at 2022-11-28 08:57:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:57:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:57:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:57 UTC)" (scheduled at 2022-11-28 08:57:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:57:57,585 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:58:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:58:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:12 UTC)" (scheduled at 2022-11-28 08:58:02.901291+00:00) notificationworker stdout | 2022-11-28 08:58:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:58:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:03 UTC)" (scheduled at 2022-11-28 08:58:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:58:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:58:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:06 UTC)" (scheduled at 2022-11-28 08:58:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:58:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:58:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:37 UTC)" (scheduled at 2022-11-28 08:58:07.716126+00:00) securityworker stdout | 2022-11-28 08:58:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:58:07,825 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:58:07,826 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 08:58:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:58:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:58:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 08:58:09,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:58:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:58:09,565 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 08:58:09,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 08:58:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:22 UTC)" (scheduled at 2022-11-28 08:58:12.901291+00:00) notificationworker stdout | 2022-11-28 08:58:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:58:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:15 UTC)" (scheduled at 2022-11-28 08:58:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:58:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:58:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:45 UTC)" (scheduled at 2022-11-28 08:58:15.911636+00:00) securityworker stdout | 2022-11-28 08:58:16,010 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:58:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:47 UTC)" (scheduled at 2022-11-28 08:58:17.016425+00:00) gcworker stdout | 2022-11-28 08:58:17,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:58:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:32 UTC)" (scheduled at 2022-11-28 08:58:22.901291+00:00) notificationworker stdout | 2022-11-28 08:58:22,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:58:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:53 UTC)" (scheduled at 2022-11-28 08:58:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:58:23,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:58:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.017) gunicorn-registry stdout | 2022-11-28 08:58:24,497 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.018) gunicorn-registry stdout | 2022-11-28 08:58:24,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:58:24,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:24,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:58:24,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:24,515 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:58:24,584 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:58:24,584 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) notificationworker stdout | 2022-11-28 08:58:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:42 UTC)" (scheduled at 2022-11-28 08:58:32.901291+00:00) notificationworker stdout | 2022-11-28 08:58:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:58:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:33 UTC)" (scheduled at 2022-11-28 08:58:33.026570+00:00) notificationworker stdout | 2022-11-28 08:58:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:58:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:33 UTC)" (scheduled at 2022-11-28 08:58:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:58:33,347 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:58:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:07 UTC)" (scheduled at 2022-11-28 08:58:37.716126+00:00) securityworker stdout | 2022-11-28 08:58:37,758 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:58:37,859 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:58:37,860 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:58:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:03:38 UTC)" (scheduled at 2022-11-28 08:58:38.420756+00:00) namespacegcworker stdout | 2022-11-28 08:58:38,596 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:03:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:58:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:58:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 08:58:39,494 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:39,495 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:58:39,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:58:39,611 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.140) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.150 118 0.150) gunicorn-web stdout | 2022-11-28 08:58:39,621 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:58:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:52 UTC)" (scheduled at 2022-11-28 08:58:42.901291+00:00) notificationworker stdout | 2022-11-28 08:58:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:58:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:58:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:15 UTC)" (scheduled at 2022-11-28 08:58:45.911636+00:00) securityworker stdout | 2022-11-28 08:58:45,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:58:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:17 UTC)" (scheduled at 2022-11-28 08:58:47.016425+00:00) gcworker stdout | 2022-11-28 08:58:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:58:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:03:49 UTC)" (scheduled at 2022-11-28 08:58:49.405459+00:00) repositorygcworker stdout | 2022-11-28 08:58:49,448 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:03:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:58:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:50 UTC)" (scheduled at 2022-11-28 08:58:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:58:50,173 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:58:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:51 UTC)" (scheduled at 2022-11-28 08:58:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:58:51,781 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:58:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:02 UTC)" (scheduled at 2022-11-28 08:58:52.901291+00:00) notificationworker stdout | 2022-11-28 08:58:52,989 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:58:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:23 UTC)" (scheduled at 2022-11-28 08:58:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:58:53,229 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:58:54,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:58:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:58:54,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:54,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:58:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:58:54,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 08:58:54,585 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) gunicorn-web stdout | 2022-11-28 08:58:54,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:58:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:56 UTC)" (scheduled at 2022-11-28 08:58:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:58:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:58:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:57 UTC)" (scheduled at 2022-11-28 08:58:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:58:57,591 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 08:59:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:59:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:12 UTC)" (scheduled at 2022-11-28 08:59:02.901291+00:00) notificationworker stdout | 2022-11-28 08:59:02,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:59:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:03 UTC)" (scheduled at 2022-11-28 08:59:03.406131+00:00) repositorygcworker stdout | 2022-11-28 08:59:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:59:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:06 UTC)" (scheduled at 2022-11-28 08:59:06.421235+00:00) namespacegcworker stdout | 2022-11-28 08:59:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:06 UTC)" executed successfully securityworker stdout | 2022-11-28 08:59:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:37 UTC)" (scheduled at 2022-11-28 08:59:07.716126+00:00) securityworker stdout | 2022-11-28 08:59:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:59:07,820 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:59:07,821 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:59:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:59:09,495 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:59:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:59:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:59:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 08:59:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.089) gunicorn-web stdout | 2022-11-28 08:59:09,563 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:59:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:22 UTC)" (scheduled at 2022-11-28 08:59:12.901291+00:00) notificationworker stdout | 2022-11-28 08:59:12,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:59:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:15 UTC)" (scheduled at 2022-11-28 08:59:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 08:59:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:15 UTC)" executed successfully securityworker stdout | 2022-11-28 08:59:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:45 UTC)" (scheduled at 2022-11-28 08:59:15.911636+00:00) securityworker stdout | 2022-11-28 08:59:16,000 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:45 UTC)" executed successfully gcworker stdout | 2022-11-28 08:59:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:47 UTC)" (scheduled at 2022-11-28 08:59:17.016425+00:00) gcworker stdout | 2022-11-28 08:59:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:59:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:32 UTC)" (scheduled at 2022-11-28 08:59:22.901291+00:00) notificationworker stdout | 2022-11-28 08:59:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:59:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:53 UTC)" (scheduled at 2022-11-28 08:59:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:59:23,151 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 08:59:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 08:59:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:59:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 08:59:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:59:24,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:59:24,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 08:59:24,573 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 08:59:24,576 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) notificationworker stdout | 2022-11-28 08:59:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:42 UTC)" (scheduled at 2022-11-28 08:59:32.901291+00:00) notificationworker stdout | 2022-11-28 08:59:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:59:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:33 UTC)" (scheduled at 2022-11-28 08:59:33.026570+00:00) notificationworker stdout | 2022-11-28 08:59:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 08:59:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:33 UTC)" (scheduled at 2022-11-28 08:59:33.321475+00:00) repositorygcworker stdout | 2022-11-28 08:59:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:33 UTC)" executed successfully securityworker stdout | 2022-11-28 08:59:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:07 UTC)" (scheduled at 2022-11-28 08:59:37.716126+00:00) securityworker stdout | 2022-11-28 08:59:37,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 08:59:37,840 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 08:59:37,841 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:59:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:04:38 UTC)" (scheduled at 2022-11-28 08:59:38.024004+00:00) notificationworker stdout | 2022-11-28 08:59:38,331 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:04:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 08:59:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 08:59:39,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:59:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:39,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:39,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:59:39,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 08:59:39,597 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.149 118 0.149) gunicorn-web stdout | 2022-11-28 08:59:39,622 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 08:59:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:52 UTC)" (scheduled at 2022-11-28 08:59:42.901291+00:00) notificationworker stdout | 2022-11-28 08:59:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 08:59:52 UTC)" executed successfully securityworker stdout | 2022-11-28 08:59:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:15 UTC)" (scheduled at 2022-11-28 08:59:45.911636+00:00) securityworker stdout | 2022-11-28 08:59:45,999 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:15 UTC)" executed successfully gcworker stdout | 2022-11-28 08:59:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:17 UTC)" (scheduled at 2022-11-28 08:59:47.016425+00:00) gcworker stdout | 2022-11-28 08:59:47,152 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 08:59:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:50 UTC)" (scheduled at 2022-11-28 08:59:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 08:59:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 08:59:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:51 UTC)" (scheduled at 2022-11-28 08:59:51.733764+00:00) namespacegcworker stdout | 2022-11-28 08:59:51,780 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 08:59:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:02 UTC)" (scheduled at 2022-11-28 08:59:52.901291+00:00) notificationworker stdout | 2022-11-28 08:59:52,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 08:59:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:23 UTC)" (scheduled at 2022-11-28 08:59:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 08:59:53,150 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 08:59:54,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:54,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:59:54,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.034 162 0.034) gunicorn-registry stdout | 2022-11-28 08:59:54,518 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 08:59:54,527 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 08:59:54,528 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 08:59:54,700 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.226 118 0.226) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:08:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.238 118 0.238) gunicorn-web stdout | 2022-11-28 08:59:54,712 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:08:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 08:59:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:56 UTC)" (scheduled at 2022-11-28 08:59:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:59:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 08:59:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:57 UTC)" (scheduled at 2022-11-28 08:59:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 08:59:57,610 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:00:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:00:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:12 UTC)" (scheduled at 2022-11-28 09:00:02.901291+00:00) notificationworker stdout | 2022-11-28 09:00:02,992 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:00:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:03 UTC)" (scheduled at 2022-11-28 09:00:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:00:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:00:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:06 UTC)" (scheduled at 2022-11-28 09:00:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:00:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:00:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:37 UTC)" (scheduled at 2022-11-28 09:00:07.716126+00:00) securityworker stdout | 2022-11-28 09:00:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:00:07,824 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:00:07,827 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:00:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:00:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:09,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:00:09,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:00:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:00:09,566 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:00:09,567 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 09:00:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:22 UTC)" (scheduled at 2022-11-28 09:00:12.901291+00:00) notificationworker stdout | 2022-11-28 09:00:12,975 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:00:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:15 UTC)" (scheduled at 2022-11-28 09:00:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:00:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:00:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:45 UTC)" (scheduled at 2022-11-28 09:00:15.911636+00:00) securityworker stdout | 2022-11-28 09:00:16,000 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:00:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:47 UTC)" (scheduled at 2022-11-28 09:00:17.016425+00:00) gcworker stdout | 2022-11-28 09:00:17,122 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:00:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:32 UTC)" (scheduled at 2022-11-28 09:00:22.901291+00:00) notificationworker stdout | 2022-11-28 09:00:22,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:00:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:53 UTC)" (scheduled at 2022-11-28 09:00:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:00:23,218 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:00:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:00:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:00:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:00:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:24,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:00:24,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:00:24,518 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.189 118 0.189) gunicorn-web stdout | 2022-11-28 09:00:24,662 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.202 118 0.202) gunicorn-web stdout | 2022-11-28 09:00:24,676 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:00:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:42 UTC)" (scheduled at 2022-11-28 09:00:32.901291+00:00) notificationworker stdout | 2022-11-28 09:00:32,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:00:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:33 UTC)" (scheduled at 2022-11-28 09:00:33.026570+00:00) notificationworker stdout | 2022-11-28 09:00:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:00:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:33 UTC)" (scheduled at 2022-11-28 09:00:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:00:33,383 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:00:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:07 UTC)" (scheduled at 2022-11-28 09:00:37.716126+00:00) securityworker stdout | 2022-11-28 09:00:37,752 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:00:37,815 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:00:37,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:00:39,507 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) gunicorn-registry stdout | 2022-11-28 09:00:39,512 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:39,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:00:39,524 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:39,524 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:00:39,526 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.160 118 0.160) gunicorn-web stdout | 2022-11-28 09:00:39,635 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:00:39,636 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.158 118 0.158) securityscanningnotificationworker stdout | 2022-11-28 09:00:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:05:41 UTC)" (scheduled at 2022-11-28 09:00:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:00:41,249 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:05:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:00:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:52 UTC)" (scheduled at 2022-11-28 09:00:42.901291+00:00) notificationworker stdout | 2022-11-28 09:00:42,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:00:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:00:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:15 UTC)" (scheduled at 2022-11-28 09:00:45.911636+00:00) securityworker stdout | 2022-11-28 09:00:46,018 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:00:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:17 UTC)" (scheduled at 2022-11-28 09:00:47.016425+00:00) gcworker stdout | 2022-11-28 09:00:47,139 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:00:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:05:48 UTC)" (scheduled at 2022-11-28 09:00:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:00:48,131 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:05:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:00:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:50 UTC)" (scheduled at 2022-11-28 09:00:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:00:50,233 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:00:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:51 UTC)" (scheduled at 2022-11-28 09:00:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:00:51,805 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:00:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:02 UTC)" (scheduled at 2022-11-28 09:00:52.901291+00:00) notificationworker stdout | 2022-11-28 09:00:52,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:00:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:23 UTC)" (scheduled at 2022-11-28 09:00:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:00:53,172 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:00:54,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:00:54,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:00:54,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:00:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:00:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:00:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:00:54,716 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.244 118 0.243) gunicorn-web stdout | 2022-11-28 09:00:54,729 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.255 118 0.255) securityscanningnotificationworker stdout | 2022-11-28 09:00:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:56 UTC)" (scheduled at 2022-11-28 09:00:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:00:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:00:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:57 UTC)" (scheduled at 2022-11-28 09:00:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:00:57,602 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:01:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:01:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:12 UTC)" (scheduled at 2022-11-28 09:01:02.901291+00:00) notificationworker stdout | 2022-11-28 09:01:03,078 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:01:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:03 UTC)" (scheduled at 2022-11-28 09:01:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:01:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:01:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:06 UTC)" (scheduled at 2022-11-28 09:01:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:01:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:01:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:37 UTC)" (scheduled at 2022-11-28 09:01:07.716126+00:00) securityworker stdout | 2022-11-28 09:01:07,802 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:01:07,919 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:01:07,920 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:01:09,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:01:09,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:01:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:01:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:01:09,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:01:09,518 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:01:09,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:01:09,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:01:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:22 UTC)" (scheduled at 2022-11-28 09:01:12.901291+00:00) notificationworker stdout | 2022-11-28 09:01:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:01:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:15 UTC)" (scheduled at 2022-11-28 09:01:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:01:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:01:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:45 UTC)" (scheduled at 2022-11-28 09:01:15.911636+00:00) securityworker stdout | 2022-11-28 09:01:16,017 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:01:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:47 UTC)" (scheduled at 2022-11-28 09:01:17.016425+00:00) gcworker stdout | 2022-11-28 09:01:17,074 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:01:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:32 UTC)" (scheduled at 2022-11-28 09:01:22.901291+00:00) notificationworker stdout | 2022-11-28 09:01:22,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:01:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:53 UTC)" (scheduled at 2022-11-28 09:01:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:01:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:01:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:01:24,491 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:01:24,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-web stdout | 2022-11-28 09:01:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:01:24,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:01:24,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:01:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:01:24,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:01:24,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) notificationworker stdout | 2022-11-28 09:01:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:42 UTC)" (scheduled at 2022-11-28 09:01:32.901291+00:00) notificationworker stdout | 2022-11-28 09:01:32,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:01:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:33 UTC)" (scheduled at 2022-11-28 09:01:33.026570+00:00) notificationworker stdout | 2022-11-28 09:01:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:01:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:33 UTC)" (scheduled at 2022-11-28 09:01:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:01:33,349 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:01:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:07 UTC)" (scheduled at 2022-11-28 09:01:37.716126+00:00) securityworker stdout | 2022-11-28 09:01:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:01:37,789 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:01:37,790 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:01:39,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:01:39,489 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:01:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:01:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:01:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:01:39,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:01:39,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:01:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 09:01:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:52 UTC)" (scheduled at 2022-11-28 09:01:42.901291+00:00) notificationworker stdout | 2022-11-28 09:01:42,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:01:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:01:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:15 UTC)" (scheduled at 2022-11-28 09:01:45.911636+00:00) securityworker stdout | 2022-11-28 09:01:45,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:01:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:17 UTC)" (scheduled at 2022-11-28 09:01:47.016425+00:00) gcworker stdout | 2022-11-28 09:01:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:01:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:50 UTC)" (scheduled at 2022-11-28 09:01:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:01:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:01:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:51 UTC)" (scheduled at 2022-11-28 09:01:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:01:51,777 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:01:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:02 UTC)" (scheduled at 2022-11-28 09:01:52.901291+00:00) notificationworker stdout | 2022-11-28 09:01:52,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:01:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:23 UTC)" (scheduled at 2022-11-28 09:01:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:01:53,192 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:01:54,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:01:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:01:54,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:01:54,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:01:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:01:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:01:54,544 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:01:54,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:01:56,165 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:56 UTC)" (scheduled at 2022-11-28 09:01:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:01:56,166 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:01:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:57 UTC)" (scheduled at 2022-11-28 09:01:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:01:57,571 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:02:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:02:02,907 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:12 UTC)" (scheduled at 2022-11-28 09:02:02.901291+00:00) notificationworker stdout | 2022-11-28 09:02:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:02:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:03 UTC)" (scheduled at 2022-11-28 09:02:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:02:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:02:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:06 UTC)" (scheduled at 2022-11-28 09:02:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:02:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:02:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:37 UTC)" (scheduled at 2022-11-28 09:02:07.716126+00:00) securityworker stdout | 2022-11-28 09:02:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:02:07,780 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:02:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:02:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:02:09,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:09,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.034 162 0.034) gunicorn-registry stdout | 2022-11-28 09:02:09,521 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:02:09,532 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:09,538 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:02:09,567 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.114) gunicorn-web stdout | 2022-11-28 09:02:09,586 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:02:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:22 UTC)" (scheduled at 2022-11-28 09:02:12.901291+00:00) notificationworker stdout | 2022-11-28 09:02:12,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:02:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:15 UTC)" (scheduled at 2022-11-28 09:02:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:02:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:02:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:45 UTC)" (scheduled at 2022-11-28 09:02:15.911636+00:00) securityworker stdout | 2022-11-28 09:02:15,985 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:02:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:47 UTC)" (scheduled at 2022-11-28 09:02:17.016425+00:00) gcworker stdout | 2022-11-28 09:02:17,105 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:02:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:32 UTC)" (scheduled at 2022-11-28 09:02:22.901291+00:00) notificationworker stdout | 2022-11-28 09:02:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:02:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:53 UTC)" (scheduled at 2022-11-28 09:02:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:02:23,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:02:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:02:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:02:24,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:02:24,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:02:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:02:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:24,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:02:24,574 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) notificationworker stdout | 2022-11-28 09:02:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:42 UTC)" (scheduled at 2022-11-28 09:02:32.901291+00:00) notificationworker stdout | 2022-11-28 09:02:32,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:02:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:33 UTC)" (scheduled at 2022-11-28 09:02:33.026570+00:00) notificationworker stdout | 2022-11-28 09:02:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:02:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:33 UTC)" (scheduled at 2022-11-28 09:02:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:02:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:02:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:07 UTC)" (scheduled at 2022-11-28 09:02:37.716126+00:00) securityworker stdout | 2022-11-28 09:02:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:02:37,757 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:02:37,757 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:02:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:02:39,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:02:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:02:39,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:02:39,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:02:39,546 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 09:02:39,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:02:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:52 UTC)" (scheduled at 2022-11-28 09:02:42.901291+00:00) notificationworker stdout | 2022-11-28 09:02:42,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:02:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:02:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:15 UTC)" (scheduled at 2022-11-28 09:02:45.911636+00:00) securityworker stdout | 2022-11-28 09:02:45,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:02:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:17 UTC)" (scheduled at 2022-11-28 09:02:47.016425+00:00) gcworker stdout | 2022-11-28 09:02:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:02:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:50 UTC)" (scheduled at 2022-11-28 09:02:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:02:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:02:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:51 UTC)" (scheduled at 2022-11-28 09:02:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:02:51,787 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:02:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:02 UTC)" (scheduled at 2022-11-28 09:02:52.901291+00:00) notificationworker stdout | 2022-11-28 09:02:52,981 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:02:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:23 UTC)" (scheduled at 2022-11-28 09:02:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:02:53,217 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:02:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:02:54,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:02:54,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:02:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:02:54,563 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:02:54,564 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) gunicorn-web stdout | 2022-11-28 09:02:54,591 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) gunicorn-web stdout | 2022-11-28 09:02:54,600 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:02:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:56 UTC)" (scheduled at 2022-11-28 09:02:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:02:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:02:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:57 UTC)" (scheduled at 2022-11-28 09:02:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:02:57,581 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:03:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:03:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:12 UTC)" (scheduled at 2022-11-28 09:03:02.901291+00:00) notificationworker stdout | 2022-11-28 09:03:02,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:03:03,409 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:03 UTC)" (scheduled at 2022-11-28 09:03:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:03:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:03:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:06 UTC)" (scheduled at 2022-11-28 09:03:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:03:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:03:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:37 UTC)" (scheduled at 2022-11-28 09:03:07.716126+00:00) securityworker stdout | 2022-11-28 09:03:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:03:07,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:03:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:03:09,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:03:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:03:09,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:03:09,494 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:09,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:03:09,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 09:03:09,538 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:03:09,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:03:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:22 UTC)" (scheduled at 2022-11-28 09:03:12.901291+00:00) notificationworker stdout | 2022-11-28 09:03:12,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:03:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:15 UTC)" (scheduled at 2022-11-28 09:03:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:03:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:03:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:45 UTC)" (scheduled at 2022-11-28 09:03:15.911636+00:00) securityworker stdout | 2022-11-28 09:03:16,024 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:03:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:47 UTC)" (scheduled at 2022-11-28 09:03:17.016425+00:00) gcworker stdout | 2022-11-28 09:03:17,084 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:03:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:32 UTC)" (scheduled at 2022-11-28 09:03:22.901291+00:00) notificationworker stdout | 2022-11-28 09:03:22,985 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:03:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:53 UTC)" (scheduled at 2022-11-28 09:03:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:03:23,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:03:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:03:24,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:03:24,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:03:24,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:03:24,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:03:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:24,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 09:03:24,565 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:24,610 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) notificationworker stdout | 2022-11-28 09:03:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:42 UTC)" (scheduled at 2022-11-28 09:03:32.901291+00:00) notificationworker stdout | 2022-11-28 09:03:32,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:03:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:33 UTC)" (scheduled at 2022-11-28 09:03:33.026570+00:00) notificationworker stdout | 2022-11-28 09:03:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:03:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:33 UTC)" (scheduled at 2022-11-28 09:03:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:03:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:03:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:07 UTC)" (scheduled at 2022-11-28 09:03:37.716126+00:00) securityworker stdout | 2022-11-28 09:03:37,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:03:37,801 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:03:37,801 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:03:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:08:38 UTC)" (scheduled at 2022-11-28 09:03:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:03:38,485 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:08:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:03:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:03:39,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:03:39,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:03:39,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:03:39,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:39,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:39,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 09:03:39,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) notificationworker stdout | 2022-11-28 09:03:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:52 UTC)" (scheduled at 2022-11-28 09:03:42.901291+00:00) notificationworker stdout | 2022-11-28 09:03:42,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:03:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:03:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:15 UTC)" (scheduled at 2022-11-28 09:03:45.911636+00:00) securityworker stdout | 2022-11-28 09:03:45,986 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:03:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:17 UTC)" (scheduled at 2022-11-28 09:03:47.016425+00:00) gcworker stdout | 2022-11-28 09:03:47,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:03:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:08:49 UTC)" (scheduled at 2022-11-28 09:03:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:03:49,446 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:08:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:03:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:50 UTC)" (scheduled at 2022-11-28 09:03:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:03:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:03:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:51 UTC)" (scheduled at 2022-11-28 09:03:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:03:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:03:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:02 UTC)" (scheduled at 2022-11-28 09:03:52.901291+00:00) notificationworker stdout | 2022-11-28 09:03:52,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:03:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:23 UTC)" (scheduled at 2022-11-28 09:03:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:03:53,140 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.013) gunicorn-registry stdout | 2022-11-28 09:03:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.010) gunicorn-registry stdout | 2022-11-28 09:03:54,504 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.003) gunicorn-web stdout | 2022-11-28 09:03:54,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:03:54,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:03:54,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:03:54,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:03:54,575 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 09:03:54,578 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) securityscanningnotificationworker stdout | 2022-11-28 09:03:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:56 UTC)" (scheduled at 2022-11-28 09:03:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:03:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:03:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:57 UTC)" (scheduled at 2022-11-28 09:03:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:03:57,683 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:04:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:04:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:12 UTC)" (scheduled at 2022-11-28 09:04:02.901291+00:00) notificationworker stdout | 2022-11-28 09:04:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:04:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:03 UTC)" (scheduled at 2022-11-28 09:04:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:04:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:04:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:06 UTC)" (scheduled at 2022-11-28 09:04:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:04:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:04:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:37 UTC)" (scheduled at 2022-11-28 09:04:07.716126+00:00) securityworker stdout | 2022-11-28 09:04:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:04:07,777 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:04:07,778 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:04:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:04:09,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) gunicorn-registry stdout | 2022-11-28 09:04:09,504 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:09,521 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:04:09,549 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:04:09,579 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) gunicorn-web stdout | 2022-11-28 09:04:09,632 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:04:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:22 UTC)" (scheduled at 2022-11-28 09:04:12.901291+00:00) notificationworker stdout | 2022-11-28 09:04:12,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:04:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:15 UTC)" (scheduled at 2022-11-28 09:04:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:04:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:04:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:45 UTC)" (scheduled at 2022-11-28 09:04:15.911636+00:00) securityworker stdout | 2022-11-28 09:04:15,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:04:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:47 UTC)" (scheduled at 2022-11-28 09:04:17.016425+00:00) gcworker stdout | 2022-11-28 09:04:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:04:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:32 UTC)" (scheduled at 2022-11-28 09:04:22.901291+00:00) notificationworker stdout | 2022-11-28 09:04:22,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:04:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:53 UTC)" (scheduled at 2022-11-28 09:04:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:04:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:04:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:04:24,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:04:24,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:04:24,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:04:24,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:04:24,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 09:04:24,541 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:04:24,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 09:04:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:42 UTC)" (scheduled at 2022-11-28 09:04:32.901291+00:00) notificationworker stdout | 2022-11-28 09:04:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:04:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:33 UTC)" (scheduled at 2022-11-28 09:04:33.026570+00:00) notificationworker stdout | 2022-11-28 09:04:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:04:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:33 UTC)" (scheduled at 2022-11-28 09:04:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:04:33,346 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:04:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:07 UTC)" (scheduled at 2022-11-28 09:04:37.716126+00:00) securityworker stdout | 2022-11-28 09:04:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:04:37,786 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:04:37,787 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:04:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:09:38 UTC)" (scheduled at 2022-11-28 09:04:38.024004+00:00) notificationworker stdout | 2022-11-28 09:04:38,081 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:09:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:04:39,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:04:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:04:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:39,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:04:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:04:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:04:39,549 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:04:39,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:04:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:52 UTC)" (scheduled at 2022-11-28 09:04:42.901291+00:00) notificationworker stdout | 2022-11-28 09:04:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:04:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:04:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:15 UTC)" (scheduled at 2022-11-28 09:04:45.911636+00:00) securityworker stdout | 2022-11-28 09:04:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:04:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:17 UTC)" (scheduled at 2022-11-28 09:04:47.016425+00:00) gcworker stdout | 2022-11-28 09:04:47,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:04:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:50 UTC)" (scheduled at 2022-11-28 09:04:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:04:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:04:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:51 UTC)" (scheduled at 2022-11-28 09:04:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:04:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:04:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:02 UTC)" (scheduled at 2022-11-28 09:04:52.901291+00:00) notificationworker stdout | 2022-11-28 09:04:52,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:04:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:23 UTC)" (scheduled at 2022-11-28 09:04:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:04:53,136 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.007) gunicorn-registry stdout | 2022-11-28 09:04:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:04:54,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:04:54,496 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:54,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:04:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:04:54,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:04:54,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:04:54,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) securityscanningnotificationworker stdout | 2022-11-28 09:04:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:56 UTC)" (scheduled at 2022-11-28 09:04:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:04:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:04:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:57 UTC)" (scheduled at 2022-11-28 09:04:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:04:57,560 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:05:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:05:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:12 UTC)" (scheduled at 2022-11-28 09:05:02.901291+00:00) notificationworker stdout | 2022-11-28 09:05:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:05:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:03 UTC)" (scheduled at 2022-11-28 09:05:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:05:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:05:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:06 UTC)" (scheduled at 2022-11-28 09:05:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:05:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:05:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:37 UTC)" (scheduled at 2022-11-28 09:05:07.716126+00:00) securityworker stdout | 2022-11-28 09:05:07,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:05:07,756 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:05:07,757 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:05:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:05:09,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:05:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:09,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:09,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:05:09,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:05:09,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:05:09,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:05:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:22 UTC)" (scheduled at 2022-11-28 09:05:12.901291+00:00) notificationworker stdout | 2022-11-28 09:05:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:05:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:15 UTC)" (scheduled at 2022-11-28 09:05:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:05:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:05:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:45 UTC)" (scheduled at 2022-11-28 09:05:15.911636+00:00) securityworker stdout | 2022-11-28 09:05:15,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:05:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:47 UTC)" (scheduled at 2022-11-28 09:05:17.016425+00:00) gcworker stdout | 2022-11-28 09:05:17,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:05:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:32 UTC)" (scheduled at 2022-11-28 09:05:22.901291+00:00) notificationworker stdout | 2022-11-28 09:05:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:05:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:53 UTC)" (scheduled at 2022-11-28 09:05:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:05:23,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:05:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:05:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:05:24,502 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:05:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:24,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:24,515 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:05:24,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:05:24,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:05:24,571 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) notificationworker stdout | 2022-11-28 09:05:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:42 UTC)" (scheduled at 2022-11-28 09:05:32.901291+00:00) notificationworker stdout | 2022-11-28 09:05:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:05:33,034 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:33 UTC)" (scheduled at 2022-11-28 09:05:33.026570+00:00) notificationworker stdout | 2022-11-28 09:05:33,034 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:05:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:33 UTC)" (scheduled at 2022-11-28 09:05:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:05:33,343 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:05:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:07 UTC)" (scheduled at 2022-11-28 09:05:37.716126+00:00) securityworker stdout | 2022-11-28 09:05:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:05:37,762 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:05:37,763 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:05:39,494 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:05:39,500 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:05:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:39,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:05:39,513 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:05:39,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:05:39,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:05:39,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) securityscanningnotificationworker stdout | 2022-11-28 09:05:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:10:41 UTC)" (scheduled at 2022-11-28 09:05:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:05:41,194 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:10:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:05:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:52 UTC)" (scheduled at 2022-11-28 09:05:42.901291+00:00) notificationworker stdout | 2022-11-28 09:05:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:05:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:05:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:15 UTC)" (scheduled at 2022-11-28 09:05:45.911636+00:00) securityworker stdout | 2022-11-28 09:05:45,977 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:05:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:17 UTC)" (scheduled at 2022-11-28 09:05:47.016425+00:00) gcworker stdout | 2022-11-28 09:05:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:05:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:10:48 UTC)" (scheduled at 2022-11-28 09:05:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:05:48,077 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:10:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:05:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:50 UTC)" (scheduled at 2022-11-28 09:05:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:05:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:05:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:51 UTC)" (scheduled at 2022-11-28 09:05:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:05:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:05:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:02 UTC)" (scheduled at 2022-11-28 09:05:52.901291+00:00) notificationworker stdout | 2022-11-28 09:05:52,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:05:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:23 UTC)" (scheduled at 2022-11-28 09:05:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:05:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:05:54,482 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:05:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:54,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:05:54,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:05:54,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:05:54,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:05:54,534 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 09:05:54,538 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) securityscanningnotificationworker stdout | 2022-11-28 09:05:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:56 UTC)" (scheduled at 2022-11-28 09:05:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:05:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:05:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:57 UTC)" (scheduled at 2022-11-28 09:05:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:05:57,550 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:06:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:06:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:12 UTC)" (scheduled at 2022-11-28 09:06:02.901291+00:00) notificationworker stdout | 2022-11-28 09:06:02,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:06:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:03 UTC)" (scheduled at 2022-11-28 09:06:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:06:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:06:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:06 UTC)" (scheduled at 2022-11-28 09:06:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:06:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:06:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:37 UTC)" (scheduled at 2022-11-28 09:06:07.716126+00:00) securityworker stdout | 2022-11-28 09:06:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:06:07,787 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:06:07,788 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:06:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:06:09,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:06:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:06:09,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:09,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) gunicorn-web stdout | 2022-11-28 09:06:09,537 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:06:09,559 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:06:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:22 UTC)" (scheduled at 2022-11-28 09:06:12.901291+00:00) notificationworker stdout | 2022-11-28 09:06:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:06:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:15 UTC)" (scheduled at 2022-11-28 09:06:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:06:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:06:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:45 UTC)" (scheduled at 2022-11-28 09:06:15.911636+00:00) securityworker stdout | 2022-11-28 09:06:15,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:06:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:47 UTC)" (scheduled at 2022-11-28 09:06:17.016425+00:00) gcworker stdout | 2022-11-28 09:06:17,055 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:06:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:32 UTC)" (scheduled at 2022-11-28 09:06:22.901291+00:00) notificationworker stdout | 2022-11-28 09:06:22,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:06:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:53 UTC)" (scheduled at 2022-11-28 09:06:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:06:23,140 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:06:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:06:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:06:24,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:06:24,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:06:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:24,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 09:06:24,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:06:24,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) notificationworker stdout | 2022-11-28 09:06:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:42 UTC)" (scheduled at 2022-11-28 09:06:32.901291+00:00) notificationworker stdout | 2022-11-28 09:06:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:06:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:33 UTC)" (scheduled at 2022-11-28 09:06:33.026570+00:00) notificationworker stdout | 2022-11-28 09:06:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:06:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:33 UTC)" (scheduled at 2022-11-28 09:06:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:06:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:06:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:07 UTC)" (scheduled at 2022-11-28 09:06:37.716126+00:00) securityworker stdout | 2022-11-28 09:06:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:06:37,752 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:06:37,752 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:06:39,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.023 162 0.023) gunicorn-registry stdout | 2022-11-28 09:06:39,508 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:06:39,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:39,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:06:39,522 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:06:39,523 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:06:39,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:06:39,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:06:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:52 UTC)" (scheduled at 2022-11-28 09:06:42.901291+00:00) notificationworker stdout | 2022-11-28 09:06:42,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:06:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:06:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:15 UTC)" (scheduled at 2022-11-28 09:06:45.911636+00:00) securityworker stdout | 2022-11-28 09:06:45,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:06:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:17 UTC)" (scheduled at 2022-11-28 09:06:47.016425+00:00) gcworker stdout | 2022-11-28 09:06:47,055 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:06:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:50 UTC)" (scheduled at 2022-11-28 09:06:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:06:50,158 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:06:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:51 UTC)" (scheduled at 2022-11-28 09:06:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:06:51,771 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:06:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:02 UTC)" (scheduled at 2022-11-28 09:06:52.901291+00:00) notificationworker stdout | 2022-11-28 09:06:52,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:06:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:23 UTC)" (scheduled at 2022-11-28 09:06:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:06:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:06:54,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:06:54,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:06:54,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:06:54,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:06:54,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 09:06:54,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:06:54,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:06:54,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.094) securityscanningnotificationworker stdout | 2022-11-28 09:06:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:56 UTC)" (scheduled at 2022-11-28 09:06:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:06:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:06:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:57 UTC)" (scheduled at 2022-11-28 09:06:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:06:57,561 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:07:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:07:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:12 UTC)" (scheduled at 2022-11-28 09:07:02.901291+00:00) notificationworker stdout | 2022-11-28 09:07:02,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:07:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:03 UTC)" (scheduled at 2022-11-28 09:07:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:07:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:07:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:06 UTC)" (scheduled at 2022-11-28 09:07:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:07:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:07:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:37 UTC)" (scheduled at 2022-11-28 09:07:07.716126+00:00) securityworker stdout | 2022-11-28 09:07:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:07:07,764 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:07:07,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:07:09,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:07:09,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:07:09,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:07:09,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:07:09,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:07:09,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) gunicorn-web stdout | 2022-11-28 09:07:09,624 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) gunicorn-web stdout | 2022-11-28 09:07:09,635 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:07:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:22 UTC)" (scheduled at 2022-11-28 09:07:12.901291+00:00) notificationworker stdout | 2022-11-28 09:07:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:07:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:15 UTC)" (scheduled at 2022-11-28 09:07:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:07:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:07:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:45 UTC)" (scheduled at 2022-11-28 09:07:15.911636+00:00) securityworker stdout | 2022-11-28 09:07:15,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:07:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:47 UTC)" (scheduled at 2022-11-28 09:07:17.016425+00:00) gcworker stdout | 2022-11-28 09:07:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:07:22,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:32 UTC)" (scheduled at 2022-11-28 09:07:22.901291+00:00) notificationworker stdout | 2022-11-28 09:07:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:07:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:53 UTC)" (scheduled at 2022-11-28 09:07:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:07:23,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:07:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:07:24,497 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:07:24,497 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.018 162 0.018) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:07:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:07:24,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:07:24,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:07:24,523 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:07:24,565 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 09:07:24,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) notificationworker stdout | 2022-11-28 09:07:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:42 UTC)" (scheduled at 2022-11-28 09:07:32.901291+00:00) notificationworker stdout | 2022-11-28 09:07:32,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:07:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:33 UTC)" (scheduled at 2022-11-28 09:07:33.026570+00:00) notificationworker stdout | 2022-11-28 09:07:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:07:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:33 UTC)" (scheduled at 2022-11-28 09:07:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:07:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:07:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:07 UTC)" (scheduled at 2022-11-28 09:07:37.716126+00:00) securityworker stdout | 2022-11-28 09:07:37,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:07:37,782 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:07:37,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:07:39,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:07:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:07:39,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:07:39,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:07:39,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:07:39,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:07:39,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:07:39,542 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 09:07:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:52 UTC)" (scheduled at 2022-11-28 09:07:42.901291+00:00) notificationworker stdout | 2022-11-28 09:07:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:07:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:07:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:15 UTC)" (scheduled at 2022-11-28 09:07:45.911636+00:00) securityworker stdout | 2022-11-28 09:07:45,948 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:07:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:17 UTC)" (scheduled at 2022-11-28 09:07:47.016425+00:00) gcworker stdout | 2022-11-28 09:07:47,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:07:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:50 UTC)" (scheduled at 2022-11-28 09:07:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:07:50,192 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:07:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:51 UTC)" (scheduled at 2022-11-28 09:07:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:07:51,795 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:07:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:02 UTC)" (scheduled at 2022-11-28 09:07:52.901291+00:00) notificationworker stdout | 2022-11-28 09:07:52,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:07:53,119 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:23 UTC)" (scheduled at 2022-11-28 09:07:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:07:53,178 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:07:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:07:54,507 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:07:54,518 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:07:54,520 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:07:54,523 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:07:54,527 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.146 118 0.146) gunicorn-web stdout | 2022-11-28 09:07:54,620 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:07:54,641 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.173 118 0.173) securityscanningnotificationworker stdout | 2022-11-28 09:07:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:56 UTC)" (scheduled at 2022-11-28 09:07:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:07:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:07:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:57 UTC)" (scheduled at 2022-11-28 09:07:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:07:57,564 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:08:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:08:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:12 UTC)" (scheduled at 2022-11-28 09:08:02.901291+00:00) notificationworker stdout | 2022-11-28 09:08:02,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:08:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:03 UTC)" (scheduled at 2022-11-28 09:08:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:08:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:08:06,431 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:06 UTC)" (scheduled at 2022-11-28 09:08:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:08:06,432 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:08:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:37 UTC)" (scheduled at 2022-11-28 09:08:07.716126+00:00) securityworker stdout | 2022-11-28 09:08:07,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:08:07,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:08:07,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:08:09,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:08:09,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:08:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:08:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:09,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:08:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:09,549 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:08:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 09:08:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:22 UTC)" (scheduled at 2022-11-28 09:08:12.901291+00:00) notificationworker stdout | 2022-11-28 09:08:12,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:08:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:15 UTC)" (scheduled at 2022-11-28 09:08:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:08:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:08:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:45 UTC)" (scheduled at 2022-11-28 09:08:15.911636+00:00) securityworker stdout | 2022-11-28 09:08:15,948 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:08:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:47 UTC)" (scheduled at 2022-11-28 09:08:17.016425+00:00) gcworker stdout | 2022-11-28 09:08:17,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:08:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:32 UTC)" (scheduled at 2022-11-28 09:08:22.901291+00:00) notificationworker stdout | 2022-11-28 09:08:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:08:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:53 UTC)" (scheduled at 2022-11-28 09:08:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:08:23,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:08:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:08:24,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:08:24,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:08:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:08:24,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:08:24,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:08:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:24,572 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:08:24,574 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) notificationworker stdout | 2022-11-28 09:08:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:42 UTC)" (scheduled at 2022-11-28 09:08:32.901291+00:00) notificationworker stdout | 2022-11-28 09:08:32,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:08:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:33 UTC)" (scheduled at 2022-11-28 09:08:33.026570+00:00) notificationworker stdout | 2022-11-28 09:08:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:08:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:33 UTC)" (scheduled at 2022-11-28 09:08:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:08:33,361 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:08:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:07 UTC)" (scheduled at 2022-11-28 09:08:37.716126+00:00) securityworker stdout | 2022-11-28 09:08:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:08:37,763 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:08:37,763 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:08:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:13:38 UTC)" (scheduled at 2022-11-28 09:08:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:08:38,463 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:13:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:08:39,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:08:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:08:39,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:08:39,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:08:39,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:39,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) gunicorn-web stdout | 2022-11-28 09:08:39,529 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:08:39,530 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.058 118 0.058) notificationworker stdout | 2022-11-28 09:08:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:52 UTC)" (scheduled at 2022-11-28 09:08:42.901291+00:00) notificationworker stdout | 2022-11-28 09:08:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:08:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:08:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:15 UTC)" (scheduled at 2022-11-28 09:08:45.911636+00:00) securityworker stdout | 2022-11-28 09:08:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:08:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:17 UTC)" (scheduled at 2022-11-28 09:08:47.016425+00:00) gcworker stdout | 2022-11-28 09:08:47,045 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:08:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:13:49 UTC)" (scheduled at 2022-11-28 09:08:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:08:49,452 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:13:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:08:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:50 UTC)" (scheduled at 2022-11-28 09:08:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:08:50,165 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:08:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:51 UTC)" (scheduled at 2022-11-28 09:08:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:08:51,771 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:08:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:02 UTC)" (scheduled at 2022-11-28 09:08:52.901291+00:00) notificationworker stdout | 2022-11-28 09:08:52,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:08:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:23 UTC)" (scheduled at 2022-11-28 09:08:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:08:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:08:54,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 09:08:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:08:54,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:08:54,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:08:54,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:54,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:08:54,544 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 09:08:54,561 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) securityscanningnotificationworker stdout | 2022-11-28 09:08:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:56 UTC)" (scheduled at 2022-11-28 09:08:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:08:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:08:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:57 UTC)" (scheduled at 2022-11-28 09:08:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:08:57,641 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:09:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:09:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:12 UTC)" (scheduled at 2022-11-28 09:09:02.901291+00:00) notificationworker stdout | 2022-11-28 09:09:02,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:09:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:03 UTC)" (scheduled at 2022-11-28 09:09:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:09:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:09:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:06 UTC)" (scheduled at 2022-11-28 09:09:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:09:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:09:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:37 UTC)" (scheduled at 2022-11-28 09:09:07.716126+00:00) securityworker stdout | 2022-11-28 09:09:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:09:07,765 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:09:07,766 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:09:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:09:09,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:09:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:09:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:09,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 09:09:09,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:09:09,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) notificationworker stdout | 2022-11-28 09:09:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:22 UTC)" (scheduled at 2022-11-28 09:09:12.901291+00:00) notificationworker stdout | 2022-11-28 09:09:12,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:09:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:15 UTC)" (scheduled at 2022-11-28 09:09:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:09:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:09:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:45 UTC)" (scheduled at 2022-11-28 09:09:15.911636+00:00) securityworker stdout | 2022-11-28 09:09:15,950 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:09:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:47 UTC)" (scheduled at 2022-11-28 09:09:17.016425+00:00) gcworker stdout | 2022-11-28 09:09:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:09:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:32 UTC)" (scheduled at 2022-11-28 09:09:22.901291+00:00) notificationworker stdout | 2022-11-28 09:09:22,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:09:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:53 UTC)" (scheduled at 2022-11-28 09:09:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:09:23,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:09:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:09:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:09:24,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:09:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:09:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:09:24,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:09:24,582 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) notificationworker stdout | 2022-11-28 09:09:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:42 UTC)" (scheduled at 2022-11-28 09:09:32.901291+00:00) notificationworker stdout | 2022-11-28 09:09:32,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:09:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:33 UTC)" (scheduled at 2022-11-28 09:09:33.026570+00:00) notificationworker stdout | 2022-11-28 09:09:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:09:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:33 UTC)" (scheduled at 2022-11-28 09:09:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:09:33,361 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:09:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:07 UTC)" (scheduled at 2022-11-28 09:09:37.716126+00:00) securityworker stdout | 2022-11-28 09:09:37,759 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:09:37,809 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:09:37,809 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:09:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:14:38 UTC)" (scheduled at 2022-11-28 09:09:38.024004+00:00) notificationworker stdout | 2022-11-28 09:09:38,101 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:14:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:09:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:09:39,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:09:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:39,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:09:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:09:39,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:09:39,550 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:09:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:52 UTC)" (scheduled at 2022-11-28 09:09:42.901291+00:00) notificationworker stdout | 2022-11-28 09:09:42,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:09:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:09:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:15 UTC)" (scheduled at 2022-11-28 09:09:45.911636+00:00) securityworker stdout | 2022-11-28 09:09:45,947 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:09:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:17 UTC)" (scheduled at 2022-11-28 09:09:47.016425+00:00) gcworker stdout | 2022-11-28 09:09:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:09:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:50 UTC)" (scheduled at 2022-11-28 09:09:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:09:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:09:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:51 UTC)" (scheduled at 2022-11-28 09:09:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:09:51,771 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:09:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:02 UTC)" (scheduled at 2022-11-28 09:09:52.901291+00:00) notificationworker stdout | 2022-11-28 09:09:52,983 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:09:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:23 UTC)" (scheduled at 2022-11-28 09:09:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:09:53,226 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:09:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 09:09:54,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:09:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:54,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:09:54,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:09:54,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:09:54,593 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:09:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) gunicorn-web stdout | 2022-11-28 09:09:54,609 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:09:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:09:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:56 UTC)" (scheduled at 2022-11-28 09:09:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:09:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:09:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:57 UTC)" (scheduled at 2022-11-28 09:09:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:09:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:10:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:10:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:12 UTC)" (scheduled at 2022-11-28 09:10:02.901291+00:00) notificationworker stdout | 2022-11-28 09:10:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:10:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:03 UTC)" (scheduled at 2022-11-28 09:10:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:10:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:10:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:06 UTC)" (scheduled at 2022-11-28 09:10:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:10:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:10:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:37 UTC)" (scheduled at 2022-11-28 09:10:07.716126+00:00) securityworker stdout | 2022-11-28 09:10:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:10:07,848 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:10:07,849 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 09:10:09,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:10:09,499 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:09,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:10:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:09,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:09,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 09:10:09,590 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:10:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:22 UTC)" (scheduled at 2022-11-28 09:10:12.901291+00:00) notificationworker stdout | 2022-11-28 09:10:13,007 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:10:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:15 UTC)" (scheduled at 2022-11-28 09:10:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:10:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:10:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:45 UTC)" (scheduled at 2022-11-28 09:10:15.911636+00:00) securityworker stdout | 2022-11-28 09:10:16,107 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:10:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:47 UTC)" (scheduled at 2022-11-28 09:10:17.016425+00:00) gcworker stdout | 2022-11-28 09:10:17,165 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:10:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:32 UTC)" (scheduled at 2022-11-28 09:10:22.901291+00:00) notificationworker stdout | 2022-11-28 09:10:23,047 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:10:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:53 UTC)" (scheduled at 2022-11-28 09:10:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:10:23,185 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:10:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.013) gunicorn-registry stdout | 2022-11-28 09:10:24,499 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:10:24,500 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:24,517 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:24,518 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:10:24,521 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:24,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:24,692 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.220 118 0.220) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.243 118 0.243) gunicorn-web stdout | 2022-11-28 09:10:24,717 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:10:32,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:42 UTC)" (scheduled at 2022-11-28 09:10:32.901291+00:00) notificationworker stdout | 2022-11-28 09:10:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:33 UTC)" (scheduled at 2022-11-28 09:10:33.026570+00:00) notificationworker stdout | 2022-11-28 09:10:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:10:33,144 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:10:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:33 UTC)" (scheduled at 2022-11-28 09:10:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:10:33,457 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:10:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:07 UTC)" (scheduled at 2022-11-28 09:10:37.716126+00:00) securityworker stdout | 2022-11-28 09:10:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:10:38,060 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:10:38,061 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:10:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:10:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.022 162 0.022) gunicorn-registry stdout | 2022-11-28 09:10:39,514 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:10:39,528 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:39,531 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:39,644 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.163 118 0.163) gunicorn-web stdout | 2022-11-28 09:10:39,664 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.191 118 0.191) securityscanningnotificationworker stdout | 2022-11-28 09:10:41,166 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:15:41 UTC)" (scheduled at 2022-11-28 09:10:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:10:41,290 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:15:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:10:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:52 UTC)" (scheduled at 2022-11-28 09:10:42.901291+00:00) notificationworker stdout | 2022-11-28 09:10:42,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:10:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:10:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:15 UTC)" (scheduled at 2022-11-28 09:10:45.911636+00:00) securityworker stdout | 2022-11-28 09:10:45,994 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:10:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:17 UTC)" (scheduled at 2022-11-28 09:10:47.016425+00:00) gcworker stdout | 2022-11-28 09:10:47,226 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:10:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:15:48 UTC)" (scheduled at 2022-11-28 09:10:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:10:48,195 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:15:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:10:50,131 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:50 UTC)" (scheduled at 2022-11-28 09:10:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:10:50,240 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:10:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:51 UTC)" (scheduled at 2022-11-28 09:10:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:10:51,820 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:10:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:02 UTC)" (scheduled at 2022-11-28 09:10:52.901291+00:00) notificationworker stdout | 2022-11-28 09:10:53,086 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:10:53,118 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:23 UTC)" (scheduled at 2022-11-28 09:10:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:10:53,214 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 09:10:54,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:10:54,503 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:54,515 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:10:54,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.003) gunicorn-web stdout | 2022-11-28 09:10:54,519 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:54,526 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:10:54,623 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.151 118 0.151) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:10:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) gunicorn-web stdout | 2022-11-28 09:10:54,639 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:10:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:10:56,166 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:56 UTC)" (scheduled at 2022-11-28 09:10:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:10:56,166 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:10:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:57 UTC)" (scheduled at 2022-11-28 09:10:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:10:57,570 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:11:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:11:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:12 UTC)" (scheduled at 2022-11-28 09:11:02.901291+00:00) notificationworker stdout | 2022-11-28 09:11:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:11:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:03 UTC)" (scheduled at 2022-11-28 09:11:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:11:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:11:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:06 UTC)" (scheduled at 2022-11-28 09:11:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:11:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:11:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:37 UTC)" (scheduled at 2022-11-28 09:11:07.716126+00:00) securityworker stdout | 2022-11-28 09:11:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:11:07,812 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:11:07,813 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:11:09,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:11:09,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:11:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:11:09,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:09,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 09:11:09,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:11:09,573 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:11:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:22 UTC)" (scheduled at 2022-11-28 09:11:12.901291+00:00) notificationworker stdout | 2022-11-28 09:11:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:11:15,041 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:15 UTC)" (scheduled at 2022-11-28 09:11:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:11:15,041 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:11:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:45 UTC)" (scheduled at 2022-11-28 09:11:15.911636+00:00) securityworker stdout | 2022-11-28 09:11:15,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:11:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:47 UTC)" (scheduled at 2022-11-28 09:11:17.016425+00:00) gcworker stdout | 2022-11-28 09:11:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:11:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:32 UTC)" (scheduled at 2022-11-28 09:11:22.901291+00:00) notificationworker stdout | 2022-11-28 09:11:22,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:11:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:53 UTC)" (scheduled at 2022-11-28 09:11:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:11:23,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:11:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:11:24,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:11:24,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:11:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:11:24,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:11:24,546 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:11:24,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) notificationworker stdout | 2022-11-28 09:11:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:42 UTC)" (scheduled at 2022-11-28 09:11:32.901291+00:00) notificationworker stdout | 2022-11-28 09:11:32,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:11:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:33 UTC)" (scheduled at 2022-11-28 09:11:33.026570+00:00) notificationworker stdout | 2022-11-28 09:11:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:11:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:33 UTC)" (scheduled at 2022-11-28 09:11:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:11:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:11:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:07 UTC)" (scheduled at 2022-11-28 09:11:37.716126+00:00) securityworker stdout | 2022-11-28 09:11:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:11:37,788 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:11:37,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:11:39,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:11:39,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:39,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:11:39,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:11:39,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:39,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:11:39,557 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 09:11:39,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) notificationworker stdout | 2022-11-28 09:11:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:52 UTC)" (scheduled at 2022-11-28 09:11:42.901291+00:00) notificationworker stdout | 2022-11-28 09:11:42,963 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:11:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:11:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:15 UTC)" (scheduled at 2022-11-28 09:11:45.911636+00:00) securityworker stdout | 2022-11-28 09:11:45,985 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:11:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:17 UTC)" (scheduled at 2022-11-28 09:11:47.016425+00:00) gcworker stdout | 2022-11-28 09:11:47,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:11:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:50 UTC)" (scheduled at 2022-11-28 09:11:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:11:50,183 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:11:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:51 UTC)" (scheduled at 2022-11-28 09:11:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:11:51,800 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:11:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:02 UTC)" (scheduled at 2022-11-28 09:11:52.901291+00:00) notificationworker stdout | 2022-11-28 09:11:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:11:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:23 UTC)" (scheduled at 2022-11-28 09:11:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:11:53,166 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:11:54,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:11:54,497 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:11:54,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:11:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 09:11:54,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:11:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:11:54,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:11:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:11:54,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:11:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:11:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:56 UTC)" (scheduled at 2022-11-28 09:11:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:11:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:11:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:57 UTC)" (scheduled at 2022-11-28 09:11:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:11:57,577 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:12:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:12:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:12 UTC)" (scheduled at 2022-11-28 09:12:02.901291+00:00) notificationworker stdout | 2022-11-28 09:12:02,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:12:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:03 UTC)" (scheduled at 2022-11-28 09:12:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:12:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:12:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:06 UTC)" (scheduled at 2022-11-28 09:12:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:12:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:12:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:37 UTC)" (scheduled at 2022-11-28 09:12:07.716126+00:00) securityworker stdout | 2022-11-28 09:12:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:12:07,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:12:07,785 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:12:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:12:09,488 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:12:09,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:09,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:12:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:12:09,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 09:12:09,545 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:12:09,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) notificationworker stdout | 2022-11-28 09:12:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:22 UTC)" (scheduled at 2022-11-28 09:12:12.901291+00:00) notificationworker stdout | 2022-11-28 09:12:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:22 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:09:12:13 +0000] "GET /v2/auth?account=quayadmin&client_id=docker&offline_token=true&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 941 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.612 722 0.612) gunicorn-registry stdout | 2022-11-28 09:12:13,360 [244] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:09:12:13 +0000] "GET /v2/auth?account=quayadmin&client_id=docker&offline_token=true&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 941 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:12:13 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.081 1496 0.081) gunicorn-registry stdout | 2022-11-28 09:12:13,465 [243] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:12:13 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" exportactionlogsworker stdout | 2022-11-28 09:12:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:15 UTC)" (scheduled at 2022-11-28 09:12:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:12:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:12:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:45 UTC)" (scheduled at 2022-11-28 09:12:15.911636+00:00) securityworker stdout | 2022-11-28 09:12:15,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:12:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:47 UTC)" (scheduled at 2022-11-28 09:12:17.016425+00:00) gcworker stdout | 2022-11-28 09:12:17,101 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:12:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:32 UTC)" (scheduled at 2022-11-28 09:12:22.901291+00:00) notificationworker stdout | 2022-11-28 09:12:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:12:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:53 UTC)" (scheduled at 2022-11-28 09:12:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:12:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:12:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:12:24,488 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-registry stdout | 2022-11-28 09:12:24,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:24,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:12:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:12:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.132 118 0.132) gunicorn-web stdout | 2022-11-28 09:12:24,607 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:12:24,661 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.189 118 0.189) notificationworker stdout | 2022-11-28 09:12:32,907 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:42 UTC)" (scheduled at 2022-11-28 09:12:32.901291+00:00) notificationworker stdout | 2022-11-28 09:12:32,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:12:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:33 UTC)" (scheduled at 2022-11-28 09:12:33.026570+00:00) notificationworker stdout | 2022-11-28 09:12:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:12:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:33 UTC)" (scheduled at 2022-11-28 09:12:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:12:33,389 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:12:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:07 UTC)" (scheduled at 2022-11-28 09:12:37.716126+00:00) securityworker stdout | 2022-11-28 09:12:37,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:12:37,798 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:12:37,799 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:12:39,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:12:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:39,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:12:39,506 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:12:39,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:39,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:12:39,544 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:12:39,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:12:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:52 UTC)" (scheduled at 2022-11-28 09:12:42.901291+00:00) notificationworker stdout | 2022-11-28 09:12:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:12:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:12:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:15 UTC)" (scheduled at 2022-11-28 09:12:45.911636+00:00) securityworker stdout | 2022-11-28 09:12:45,983 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:12:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:17 UTC)" (scheduled at 2022-11-28 09:12:47.016425+00:00) gcworker stdout | 2022-11-28 09:12:47,142 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:12:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:50 UTC)" (scheduled at 2022-11-28 09:12:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:12:50,217 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:12:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:51 UTC)" (scheduled at 2022-11-28 09:12:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:12:51,920 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:12:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:02 UTC)" (scheduled at 2022-11-28 09:12:52.901291+00:00) notificationworker stdout | 2022-11-28 09:12:53,018 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:12:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:23 UTC)" (scheduled at 2022-11-28 09:12:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:12:53,187 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:12:54,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 09:12:54,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:12:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:12:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:12:54,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:12:54,658 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.186 118 0.186) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:12:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.194 118 0.193) gunicorn-web stdout | 2022-11-28 09:12:54,667 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:12:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:12:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:56 UTC)" (scheduled at 2022-11-28 09:12:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:12:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:12:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:57 UTC)" (scheduled at 2022-11-28 09:12:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:12:57,577 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:13:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:13:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:12 UTC)" (scheduled at 2022-11-28 09:13:02.901291+00:00) notificationworker stdout | 2022-11-28 09:13:02,991 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:13:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:03 UTC)" (scheduled at 2022-11-28 09:13:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:13:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:03 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.020 544 0.020) gunicorn-registry stdout | 2022-11-28 09:13:04,614 [247] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:13:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" gunicorn-registry stdout | 2022-11-28 09:13:05,273 [247] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:09:13:05 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:09:13:05 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.635 739 0.635) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:05 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.447 1709 0.447) gunicorn-registry stdout | 2022-11-28 09:13:05,737 [245] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:13:05 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" gunicorn-registry stdout | 2022-11-28 09:13:06,030 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:13:06,040 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:09:13:06 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:06 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.280 1688 0.280) namespacegcworker stdout | 2022-11-28 09:13:06,425 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:06 UTC)" (scheduled at 2022-11-28 09:13:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:13:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:13:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:37 UTC)" (scheduled at 2022-11-28 09:13:07.716126+00:00) securityworker stdout | 2022-11-28 09:13:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:13:07,891 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:13:07,893 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:13:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:13:09,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:13:09,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:13:09,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:13:09,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:13:09,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.180 118 0.180) gunicorn-web stdout | 2022-11-28 09:13:09,651 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.187 118 0.187) gunicorn-web stdout | 2022-11-28 09:13:09,658 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-registry stdout | 2022-11-28 09:13:11,081 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:13:11,082 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:09:13:11 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:11 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.028 1688 0.028) notificationworker stdout | 2022-11-28 09:13:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:22 UTC)" (scheduled at 2022-11-28 09:13:12.901291+00:00) notificationworker stdout | 2022-11-28 09:13:12,992 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:13:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:15 UTC)" (scheduled at 2022-11-28 09:13:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:13:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:13:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:45 UTC)" (scheduled at 2022-11-28 09:13:15.911636+00:00) securityworker stdout | 2022-11-28 09:13:16,058 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:13:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:47 UTC)" (scheduled at 2022-11-28 09:13:17.016425+00:00) gcworker stdout | 2022-11-28 09:13:17,093 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:47 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:13:21,214 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:13:21,216 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:13:21 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:21 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.110 1688 0.110) notificationworker stdout | 2022-11-28 09:13:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:32 UTC)" (scheduled at 2022-11-28 09:13:22.901291+00:00) notificationworker stdout | 2022-11-28 09:13:22,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:13:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:53 UTC)" (scheduled at 2022-11-28 09:13:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:13:23,269 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:13:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:13:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:13:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:13:24,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:13:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:13:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:13:24,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:13:24,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.129) gunicorn-web stdout | 2022-11-28 09:13:24,601 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:13:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:42 UTC)" (scheduled at 2022-11-28 09:13:32.901291+00:00) notificationworker stdout | 2022-11-28 09:13:32,986 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:13:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:33 UTC)" (scheduled at 2022-11-28 09:13:33.026570+00:00) notificationworker stdout | 2022-11-28 09:13:33,030 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:13:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:33 UTC)" (scheduled at 2022-11-28 09:13:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:13:33,400 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:33 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:13:36,245 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:13:36,246 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:13:36 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:36 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.016 1688 0.016) securityworker stdout | 2022-11-28 09:13:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:07 UTC)" (scheduled at 2022-11-28 09:13:37.716126+00:00) securityworker stdout | 2022-11-28 09:13:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:13:37,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:13:37,797 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:13:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:18:38 UTC)" (scheduled at 2022-11-28 09:13:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:13:38,560 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:18:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:13:39,493 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:13:39,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:13:39,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:13:39,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:13:39,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:13:39,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 09:13:39,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 09:13:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:13:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:52 UTC)" (scheduled at 2022-11-28 09:13:42.901291+00:00) notificationworker stdout | 2022-11-28 09:13:42,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:13:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:13:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:15 UTC)" (scheduled at 2022-11-28 09:13:45.911636+00:00) securityworker stdout | 2022-11-28 09:13:45,985 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:13:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:17 UTC)" (scheduled at 2022-11-28 09:13:47.016425+00:00) gcworker stdout | 2022-11-28 09:13:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:13:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:18:49 UTC)" (scheduled at 2022-11-28 09:13:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:13:49,461 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:18:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:13:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:50 UTC)" (scheduled at 2022-11-28 09:13:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:13:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:13:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:51 UTC)" (scheduled at 2022-11-28 09:13:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:13:51,784 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:13:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:02 UTC)" (scheduled at 2022-11-28 09:13:52.901291+00:00) notificationworker stdout | 2022-11-28 09:13:52,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:13:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:23 UTC)" (scheduled at 2022-11-28 09:13:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:13:53,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:13:54,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:13:54,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:13:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:13:54,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:13:54,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:13:54,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:13:54,579 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:13:54,580 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:13:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:13:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) securityscanningnotificationworker stdout | 2022-11-28 09:13:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:56 UTC)" (scheduled at 2022-11-28 09:13:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:13:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:56 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:13:56,297 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:13:56,301 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:13:56 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:13:56 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.034 1688 0.034) securityscanningnotificationworker stdout | 2022-11-28 09:13:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:57 UTC)" (scheduled at 2022-11-28 09:13:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:13:57,629 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:14:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:14:02,907 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:12 UTC)" (scheduled at 2022-11-28 09:14:02.901291+00:00) notificationworker stdout | 2022-11-28 09:14:03,021 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:14:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:03 UTC)" (scheduled at 2022-11-28 09:14:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:14:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:14:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:06 UTC)" (scheduled at 2022-11-28 09:14:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:14:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:14:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:37 UTC)" (scheduled at 2022-11-28 09:14:07.716126+00:00) securityworker stdout | 2022-11-28 09:14:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:14:07,856 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:14:07,857 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:14:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:14:09,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:14:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:14:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:14:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:14:09,581 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:14:09,582 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.111) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) notificationworker stdout | 2022-11-28 09:14:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:22 UTC)" (scheduled at 2022-11-28 09:14:12.901291+00:00) notificationworker stdout | 2022-11-28 09:14:12,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:14:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:15 UTC)" (scheduled at 2022-11-28 09:14:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:14:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:14:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:45 UTC)" (scheduled at 2022-11-28 09:14:15.911636+00:00) securityworker stdout | 2022-11-28 09:14:15,989 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:14:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:47 UTC)" (scheduled at 2022-11-28 09:14:17.016425+00:00) gcworker stdout | 2022-11-28 09:14:17,077 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:14:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:32 UTC)" (scheduled at 2022-11-28 09:14:22.901291+00:00) notificationworker stdout | 2022-11-28 09:14:22,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:14:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:53 UTC)" (scheduled at 2022-11-28 09:14:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:14:23,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:14:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:14:24,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:14:24,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:14:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:24,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:14:24,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:14:24,584 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) gunicorn-web stdout | 2022-11-28 09:14:24,607 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:14:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:42 UTC)" (scheduled at 2022-11-28 09:14:32.901291+00:00) notificationworker stdout | 2022-11-28 09:14:32,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:14:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:33 UTC)" (scheduled at 2022-11-28 09:14:33.026570+00:00) notificationworker stdout | 2022-11-28 09:14:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:14:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:33 UTC)" (scheduled at 2022-11-28 09:14:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:14:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:14:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:07 UTC)" (scheduled at 2022-11-28 09:14:37.716126+00:00) securityworker stdout | 2022-11-28 09:14:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:14:37,794 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:14:37,795 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:14:38,026 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:19:38 UTC)" (scheduled at 2022-11-28 09:14:38.024004+00:00) notificationworker stdout | 2022-11-28 09:14:38,114 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:19:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:14:39,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:14:39,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:14:39,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:39,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:14:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:14:39,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 09:14:39,582 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) gunicorn-web stdout | 2022-11-28 09:14:39,583 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:14:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:52 UTC)" (scheduled at 2022-11-28 09:14:42.901291+00:00) notificationworker stdout | 2022-11-28 09:14:42,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:14:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:14:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:15 UTC)" (scheduled at 2022-11-28 09:14:45.911636+00:00) securityworker stdout | 2022-11-28 09:14:45,971 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:14:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:17 UTC)" (scheduled at 2022-11-28 09:14:47.016425+00:00) gcworker stdout | 2022-11-28 09:14:47,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:14:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:50 UTC)" (scheduled at 2022-11-28 09:14:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:14:50,197 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:14:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:51 UTC)" (scheduled at 2022-11-28 09:14:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:14:51,811 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:14:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:02 UTC)" (scheduled at 2022-11-28 09:14:52.901291+00:00) notificationworker stdout | 2022-11-28 09:14:52,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:14:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:23 UTC)" (scheduled at 2022-11-28 09:14:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:14:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:14:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:14:54,495 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:14:54,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:14:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:14:54,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:14:54,589 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:14:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.139 118 0.139) gunicorn-web stdout | 2022-11-28 09:14:54,611 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:14:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:14:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:56 UTC)" (scheduled at 2022-11-28 09:14:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:14:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:14:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:57 UTC)" (scheduled at 2022-11-28 09:14:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:14:57,560 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:15:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:12 UTC)" (scheduled at 2022-11-28 09:15:02.901291+00:00) notificationworker stdout | 2022-11-28 09:15:02,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:15:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:03 UTC)" (scheduled at 2022-11-28 09:15:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:15:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:15:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:06 UTC)" (scheduled at 2022-11-28 09:15:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:15:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:15:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:37 UTC)" (scheduled at 2022-11-28 09:15:07.716126+00:00) securityworker stdout | 2022-11-28 09:15:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:15:07,788 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:15:07,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:15:09,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:15:09,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:15:09,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:09,499 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:15:09,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) gunicorn-web stdout | 2022-11-28 09:15:09,602 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 09:15:09,616 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" globalpromstats stdout | 2022-11-28 09:15:12,518 [66] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 10:15:12 UTC)" (scheduled at 2022-11-28 09:15:12.517266+00:00) globalpromstats stdout | 2022-11-28 09:15:12,521 [66] [INFO] [redis_lock.acquire] Got lock for 'lock:GLOBAL_PROM_STATS'. globalpromstats stdout | 2022-11-28 09:15:12,603 [66] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-11-28 10:15:12 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:22 UTC)" (scheduled at 2022-11-28 09:15:12.901291+00:00) notificationworker stdout | 2022-11-28 09:15:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:15:15,038 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:15 UTC)" (scheduled at 2022-11-28 09:15:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:15:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:15:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:45 UTC)" (scheduled at 2022-11-28 09:15:15.911636+00:00) securityworker stdout | 2022-11-28 09:15:15,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:15:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:47 UTC)" (scheduled at 2022-11-28 09:15:17.016425+00:00) gcworker stdout | 2022-11-28 09:15:17,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:32 UTC)" (scheduled at 2022-11-28 09:15:22.901291+00:00) notificationworker stdout | 2022-11-28 09:15:23,062 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:15:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:53 UTC)" (scheduled at 2022-11-28 09:15:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:15:23,255 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:15:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:15:24,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:15:24,504 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:15:24,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:24,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:15:24,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:15:24,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.214 118 0.214) gunicorn-web stdout | 2022-11-28 09:15:24,685 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.220 118 0.220) gunicorn-web stdout | 2022-11-28 09:15:24,693 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:15:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:42 UTC)" (scheduled at 2022-11-28 09:15:32.901291+00:00) notificationworker stdout | 2022-11-28 09:15:32,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:33 UTC)" (scheduled at 2022-11-28 09:15:33.026570+00:00) notificationworker stdout | 2022-11-28 09:15:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:15:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:33 UTC)" (scheduled at 2022-11-28 09:15:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:15:33,370 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:15:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:07 UTC)" (scheduled at 2022-11-28 09:15:37.716126+00:00) securityworker stdout | 2022-11-28 09:15:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:15:37,818 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:15:37,819 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:15:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:15:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:15:39,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:15:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:15:39,546 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.106) gunicorn-web stdout | 2022-11-28 09:15:39,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:15:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:20:41 UTC)" (scheduled at 2022-11-28 09:15:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:15:41,221 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:20:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:52 UTC)" (scheduled at 2022-11-28 09:15:42.901291+00:00) notificationworker stdout | 2022-11-28 09:15:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:15:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:15:45,917 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:15 UTC)" (scheduled at 2022-11-28 09:15:45.911636+00:00) securityworker stdout | 2022-11-28 09:15:45,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:15:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:17 UTC)" (scheduled at 2022-11-28 09:15:47.016425+00:00) gcworker stdout | 2022-11-28 09:15:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:15:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:20:48 UTC)" (scheduled at 2022-11-28 09:15:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:15:48,090 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:20:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:15:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:50 UTC)" (scheduled at 2022-11-28 09:15:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:15:50,168 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:15:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:51 UTC)" (scheduled at 2022-11-28 09:15:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:15:51,770 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:15:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:02 UTC)" (scheduled at 2022-11-28 09:15:52.901291+00:00) notificationworker stdout | 2022-11-28 09:15:52,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:15:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:23 UTC)" (scheduled at 2022-11-28 09:15:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:15:53,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:15:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:15:54,499 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:15:54,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:15:54,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:15:54,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:15:54,517 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.143 118 0.143) gunicorn-web stdout | 2022-11-28 09:15:54,621 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:15:54,642 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:15:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:15:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.167 118 0.167) securityscanningnotificationworker stdout | 2022-11-28 09:15:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:56 UTC)" (scheduled at 2022-11-28 09:15:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:15:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:15:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:57 UTC)" (scheduled at 2022-11-28 09:15:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:15:57,626 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:16:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:16:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:12 UTC)" (scheduled at 2022-11-28 09:16:02.901291+00:00) notificationworker stdout | 2022-11-28 09:16:02,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:16:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:03 UTC)" (scheduled at 2022-11-28 09:16:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:16:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:16:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:06 UTC)" (scheduled at 2022-11-28 09:16:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:16:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:16:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:37 UTC)" (scheduled at 2022-11-28 09:16:07.716126+00:00) securityworker stdout | 2022-11-28 09:16:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:16:07,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:16:07,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:16:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:16:09,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:16:09,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:09,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 09:16:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.085) gunicorn-web stdout | 2022-11-28 09:16:09,556 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.086) gunicorn-web stdout | 2022-11-28 09:16:09,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:16:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:22 UTC)" (scheduled at 2022-11-28 09:16:12.901291+00:00) notificationworker stdout | 2022-11-28 09:16:12,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:16:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:15 UTC)" (scheduled at 2022-11-28 09:16:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:16:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:16:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:45 UTC)" (scheduled at 2022-11-28 09:16:15.911636+00:00) securityworker stdout | 2022-11-28 09:16:15,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:16:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:47 UTC)" (scheduled at 2022-11-28 09:16:17.016425+00:00) gcworker stdout | 2022-11-28 09:16:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:16:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:32 UTC)" (scheduled at 2022-11-28 09:16:22.901291+00:00) notificationworker stdout | 2022-11-28 09:16:22,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:16:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:53 UTC)" (scheduled at 2022-11-28 09:16:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:16:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:16:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:16:24,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:16:24,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:24,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:16:24,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:16:24,493 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:16:24,565 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) gunicorn-web stdout | 2022-11-28 09:16:24,574 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:16:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:42 UTC)" (scheduled at 2022-11-28 09:16:32.901291+00:00) notificationworker stdout | 2022-11-28 09:16:32,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:16:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:33 UTC)" (scheduled at 2022-11-28 09:16:33.026570+00:00) notificationworker stdout | 2022-11-28 09:16:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:16:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:33 UTC)" (scheduled at 2022-11-28 09:16:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:16:33,345 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:16:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:07 UTC)" (scheduled at 2022-11-28 09:16:37.716126+00:00) securityworker stdout | 2022-11-28 09:16:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:16:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:16:37,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:16:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:16:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:16:39,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:39,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:16:39,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:39,518 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:16:39,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:16:39,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) notificationworker stdout | 2022-11-28 09:16:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:52 UTC)" (scheduled at 2022-11-28 09:16:42.901291+00:00) notificationworker stdout | 2022-11-28 09:16:42,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:16:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:16:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:15 UTC)" (scheduled at 2022-11-28 09:16:45.911636+00:00) securityworker stdout | 2022-11-28 09:16:45,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:16:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:17 UTC)" (scheduled at 2022-11-28 09:16:47.016425+00:00) gcworker stdout | 2022-11-28 09:16:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:16:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:50 UTC)" (scheduled at 2022-11-28 09:16:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:16:50,205 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:16:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:51 UTC)" (scheduled at 2022-11-28 09:16:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:16:51,769 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:16:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:02 UTC)" (scheduled at 2022-11-28 09:16:52.901291+00:00) notificationworker stdout | 2022-11-28 09:16:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:16:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:23 UTC)" (scheduled at 2022-11-28 09:16:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:16:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:16:54,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:16:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:16:54,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:54,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:16:54,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:16:54,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 09:16:54,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:16:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 09:16:54,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:16:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:16:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:56 UTC)" (scheduled at 2022-11-28 09:16:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:16:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:16:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:57 UTC)" (scheduled at 2022-11-28 09:16:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:16:57,566 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:17:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:17:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:12 UTC)" (scheduled at 2022-11-28 09:17:02.901291+00:00) notificationworker stdout | 2022-11-28 09:17:02,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:17:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:03 UTC)" (scheduled at 2022-11-28 09:17:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:17:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:17:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:06 UTC)" (scheduled at 2022-11-28 09:17:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:17:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:17:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:37 UTC)" (scheduled at 2022-11-28 09:17:07.716126+00:00) securityworker stdout | 2022-11-28 09:17:07,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:17:07,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:17:07,781 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:17:09,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:17:09,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:17:09,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:09,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 09:17:09,522 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:09,524 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:17:09,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) gunicorn-web stdout | 2022-11-28 09:17:09,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:17:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:22 UTC)" (scheduled at 2022-11-28 09:17:12.901291+00:00) notificationworker stdout | 2022-11-28 09:17:12,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:17:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:15 UTC)" (scheduled at 2022-11-28 09:17:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:17:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:17:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:45 UTC)" (scheduled at 2022-11-28 09:17:15.911636+00:00) securityworker stdout | 2022-11-28 09:17:15,984 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:17:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:47 UTC)" (scheduled at 2022-11-28 09:17:17.016425+00:00) gcworker stdout | 2022-11-28 09:17:17,083 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:17:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:32 UTC)" (scheduled at 2022-11-28 09:17:22.901291+00:00) notificationworker stdout | 2022-11-28 09:17:22,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:17:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:53 UTC)" (scheduled at 2022-11-28 09:17:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:17:23,190 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:17:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:17:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:17:24,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:17:24,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:17:24,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:17:24,503 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:24,568 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.099) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 09:17:24,593 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:17:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:42 UTC)" (scheduled at 2022-11-28 09:17:32.901291+00:00) notificationworker stdout | 2022-11-28 09:17:32,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:17:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:33 UTC)" (scheduled at 2022-11-28 09:17:33.026570+00:00) notificationworker stdout | 2022-11-28 09:17:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:17:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:33 UTC)" (scheduled at 2022-11-28 09:17:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:17:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:17:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:07 UTC)" (scheduled at 2022-11-28 09:17:37.716126+00:00) securityworker stdout | 2022-11-28 09:17:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:17:37,809 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:17:37,810 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:17:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:17:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:39,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:17:39,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:17:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:17:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 09:17:39,618 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:17:39,635 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) notificationworker stdout | 2022-11-28 09:17:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:52 UTC)" (scheduled at 2022-11-28 09:17:42.901291+00:00) notificationworker stdout | 2022-11-28 09:17:42,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:17:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:17:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:15 UTC)" (scheduled at 2022-11-28 09:17:45.911636+00:00) securityworker stdout | 2022-11-28 09:17:45,994 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:17:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:17 UTC)" (scheduled at 2022-11-28 09:17:47.016425+00:00) gcworker stdout | 2022-11-28 09:17:47,137 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:17:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:50 UTC)" (scheduled at 2022-11-28 09:17:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:17:50,168 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:17:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:51 UTC)" (scheduled at 2022-11-28 09:17:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:17:51,824 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:17:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:02 UTC)" (scheduled at 2022-11-28 09:17:52.901291+00:00) notificationworker stdout | 2022-11-28 09:17:52,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:17:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:23 UTC)" (scheduled at 2022-11-28 09:17:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:17:53,210 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:17:54,504 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:17:54,509 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:17:54,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:54,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:17:54,518 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:17:54,520 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:17:54,593 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:17:54,593 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:17:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:17:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) securityscanningnotificationworker stdout | 2022-11-28 09:17:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:56 UTC)" (scheduled at 2022-11-28 09:17:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:17:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:17:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:57 UTC)" (scheduled at 2022-11-28 09:17:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:17:57,603 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:18:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:18:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:12 UTC)" (scheduled at 2022-11-28 09:18:02.901291+00:00) notificationworker stdout | 2022-11-28 09:18:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:18:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:03 UTC)" (scheduled at 2022-11-28 09:18:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:18:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:18:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:06 UTC)" (scheduled at 2022-11-28 09:18:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:18:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:18:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:37 UTC)" (scheduled at 2022-11-28 09:18:07.716126+00:00) securityworker stdout | 2022-11-28 09:18:07,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:18:07,857 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:18:07,858 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:18:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:18:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:18:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:18:09,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:18:09,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 09:18:09,600 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.157 118 0.157) gunicorn-web stdout | 2022-11-28 09:18:09,630 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:18:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:22 UTC)" (scheduled at 2022-11-28 09:18:12.901291+00:00) notificationworker stdout | 2022-11-28 09:18:12,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:18:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:15 UTC)" (scheduled at 2022-11-28 09:18:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:18:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:18:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:45 UTC)" (scheduled at 2022-11-28 09:18:15.911636+00:00) securityworker stdout | 2022-11-28 09:18:16,054 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:18:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:47 UTC)" (scheduled at 2022-11-28 09:18:17.016425+00:00) gcworker stdout | 2022-11-28 09:18:17,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:18:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:32 UTC)" (scheduled at 2022-11-28 09:18:22.901291+00:00) notificationworker stdout | 2022-11-28 09:18:22,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:18:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:53 UTC)" (scheduled at 2022-11-28 09:18:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:18:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:18:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:18:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:18:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:18:24,502 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:18:24,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:18:24,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:18:24,600 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 09:18:24,611 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.138) notificationworker stdout | 2022-11-28 09:18:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:42 UTC)" (scheduled at 2022-11-28 09:18:32.901291+00:00) notificationworker stdout | 2022-11-28 09:18:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:18:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:33 UTC)" (scheduled at 2022-11-28 09:18:33.026570+00:00) notificationworker stdout | 2022-11-28 09:18:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:18:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:33 UTC)" (scheduled at 2022-11-28 09:18:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:18:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:18:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:07 UTC)" (scheduled at 2022-11-28 09:18:37.716126+00:00) securityworker stdout | 2022-11-28 09:18:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:18:37,809 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:18:37,810 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:18:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:23:38 UTC)" (scheduled at 2022-11-28 09:18:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:18:38,464 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:23:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:18:39,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.004) gunicorn-registry stdout | 2022-11-28 09:18:39,504 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:39,520 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:39,520 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:18:39,523 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:18:39,527 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:18:39,572 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:18:39,572 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 09:18:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:52 UTC)" (scheduled at 2022-11-28 09:18:42.901291+00:00) notificationworker stdout | 2022-11-28 09:18:42,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:18:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:18:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:15 UTC)" (scheduled at 2022-11-28 09:18:45.911636+00:00) securityworker stdout | 2022-11-28 09:18:45,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:18:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:17 UTC)" (scheduled at 2022-11-28 09:18:47.016425+00:00) gcworker stdout | 2022-11-28 09:18:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:18:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:23:49 UTC)" (scheduled at 2022-11-28 09:18:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:18:49,441 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:23:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:18:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:50 UTC)" (scheduled at 2022-11-28 09:18:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:18:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:18:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:51 UTC)" (scheduled at 2022-11-28 09:18:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:18:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:18:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:02 UTC)" (scheduled at 2022-11-28 09:18:52.901291+00:00) notificationworker stdout | 2022-11-28 09:18:52,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:18:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:23 UTC)" (scheduled at 2022-11-28 09:18:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:18:53,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:18:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:18:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:18:54,510 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:18:54,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:18:54,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 09:18:54,571 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:18:54,603 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:18:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:18:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) securityscanningnotificationworker stdout | 2022-11-28 09:18:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:56 UTC)" (scheduled at 2022-11-28 09:18:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:18:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:18:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:57 UTC)" (scheduled at 2022-11-28 09:18:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:18:57,659 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:19:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:19:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:12 UTC)" (scheduled at 2022-11-28 09:19:02.901291+00:00) notificationworker stdout | 2022-11-28 09:19:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:19:03,409 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:03 UTC)" (scheduled at 2022-11-28 09:19:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:19:03,409 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:19:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:06 UTC)" (scheduled at 2022-11-28 09:19:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:19:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:19:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:37 UTC)" (scheduled at 2022-11-28 09:19:07.716126+00:00) securityworker stdout | 2022-11-28 09:19:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:19:07,755 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:19:07,755 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:19:09,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:19:09,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:19:09,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:19:09,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:19:09,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:19:09,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:19:09,544 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:19:09,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:19:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:22 UTC)" (scheduled at 2022-11-28 09:19:12.901291+00:00) notificationworker stdout | 2022-11-28 09:19:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:19:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:15 UTC)" (scheduled at 2022-11-28 09:19:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:19:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:19:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:45 UTC)" (scheduled at 2022-11-28 09:19:15.911636+00:00) securityworker stdout | 2022-11-28 09:19:16,000 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:19:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:47 UTC)" (scheduled at 2022-11-28 09:19:17.016425+00:00) gcworker stdout | 2022-11-28 09:19:17,113 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:19:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:32 UTC)" (scheduled at 2022-11-28 09:19:22.901291+00:00) notificationworker stdout | 2022-11-28 09:19:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:19:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:53 UTC)" (scheduled at 2022-11-28 09:19:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:19:23,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:19:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:19:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:19:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:19:24,498 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-web stdout | 2022-11-28 09:19:24,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:19:24,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:19:24,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:19:24,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:19:24,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.096) notificationworker stdout | 2022-11-28 09:19:32,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:42 UTC)" (scheduled at 2022-11-28 09:19:32.901291+00:00) notificationworker stdout | 2022-11-28 09:19:32,993 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:19:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:33 UTC)" (scheduled at 2022-11-28 09:19:33.026570+00:00) notificationworker stdout | 2022-11-28 09:19:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:19:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:33 UTC)" (scheduled at 2022-11-28 09:19:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:19:33,371 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:19:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:07 UTC)" (scheduled at 2022-11-28 09:19:37.716126+00:00) securityworker stdout | 2022-11-28 09:19:37,748 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:19:37,800 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:19:37,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:19:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:24:38 UTC)" (scheduled at 2022-11-28 09:19:38.024004+00:00) notificationworker stdout | 2022-11-28 09:19:38,067 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:24:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:19:39,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:19:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:19:39,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:19:39,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:19:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:19:39,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:19:39,559 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:19:39,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) notificationworker stdout | 2022-11-28 09:19:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:52 UTC)" (scheduled at 2022-11-28 09:19:42.901291+00:00) notificationworker stdout | 2022-11-28 09:19:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:19:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:19:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:15 UTC)" (scheduled at 2022-11-28 09:19:45.911636+00:00) securityworker stdout | 2022-11-28 09:19:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:19:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:17 UTC)" (scheduled at 2022-11-28 09:19:47.016425+00:00) gcworker stdout | 2022-11-28 09:19:47,054 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:19:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:50 UTC)" (scheduled at 2022-11-28 09:19:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:19:50,192 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:19:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:51 UTC)" (scheduled at 2022-11-28 09:19:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:19:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:19:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:02 UTC)" (scheduled at 2022-11-28 09:19:52.901291+00:00) buildlogsarchiver stdout | 2022-11-28 09:19:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:23 UTC)" (scheduled at 2022-11-28 09:19:53.113782+00:00) notificationworker stdout | 2022-11-28 09:19:53,155 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:19:53,289 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:19:54,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:19:54,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:19:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:19:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:19:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:19:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:19:54,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:19:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 09:19:54,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:19:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:19:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:56 UTC)" (scheduled at 2022-11-28 09:19:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:19:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:19:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:57 UTC)" (scheduled at 2022-11-28 09:19:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:19:57,549 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:20:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:20:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:12 UTC)" (scheduled at 2022-11-28 09:20:02.901291+00:00) notificationworker stdout | 2022-11-28 09:20:02,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:20:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:03 UTC)" (scheduled at 2022-11-28 09:20:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:20:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:20:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:06 UTC)" (scheduled at 2022-11-28 09:20:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:20:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:20:07,727 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:37 UTC)" (scheduled at 2022-11-28 09:20:07.716126+00:00) securityworker stdout | 2022-11-28 09:20:07,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:20:07,813 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:20:07,814 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:20:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.008) gunicorn-registry stdout | 2022-11-28 09:20:09,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:20:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:09,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:20:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:09,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:20:09,564 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 09:20:09,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:20:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:22 UTC)" (scheduled at 2022-11-28 09:20:12.901291+00:00) notificationworker stdout | 2022-11-28 09:20:12,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:20:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:15 UTC)" (scheduled at 2022-11-28 09:20:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:20:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:20:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:45 UTC)" (scheduled at 2022-11-28 09:20:15.911636+00:00) securityworker stdout | 2022-11-28 09:20:15,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:20:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:47 UTC)" (scheduled at 2022-11-28 09:20:17.016425+00:00) gcworker stdout | 2022-11-28 09:20:17,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:20:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:32 UTC)" (scheduled at 2022-11-28 09:20:22.901291+00:00) notificationworker stdout | 2022-11-28 09:20:22,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:20:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:53 UTC)" (scheduled at 2022-11-28 09:20:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:20:23,216 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:20:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:20:24,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 09:20:24,498 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:24,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:20:24,522 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 09:20:24,581 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:20:24,591 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.123) notificationworker stdout | 2022-11-28 09:20:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:42 UTC)" (scheduled at 2022-11-28 09:20:32.901291+00:00) notificationworker stdout | 2022-11-28 09:20:32,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:20:33,031 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:33 UTC)" (scheduled at 2022-11-28 09:20:33.026570+00:00) notificationworker stdout | 2022-11-28 09:20:33,032 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:20:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:33 UTC)" (scheduled at 2022-11-28 09:20:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:20:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:20:37,727 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:07 UTC)" (scheduled at 2022-11-28 09:20:37.716126+00:00) securityworker stdout | 2022-11-28 09:20:37,771 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:20:37,875 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:20:37,879 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:07 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:20:38 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.040 544 0.040) gunicorn-registry stdout | 2022-11-28 09:20:38,500 [245] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:20:38 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:09:20:39 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.770 739 0.770) gunicorn-registry stdout | 2022-11-28 09:20:39,306 [245] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:09:20:39 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1081 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:20:39,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:20:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:20:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:39,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:20:39,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:39,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 09:20:39,573 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:20:39,599 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.122) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:20:39 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.660 1709 0.660) gunicorn-registry stdout | 2022-11-28 09:20:39,982 [246] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:20:39 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" gunicorn-registry stdout | 2022-11-28 09:20:40,068 [245] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:20:40,085 [245] [INFO] [gunicorn.access] - - [28/Nov/2022:09:20:40 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:20:40 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.097 1688 0.097) securityscanningnotificationworker stdout | 2022-11-28 09:20:41,167 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:25:41 UTC)" (scheduled at 2022-11-28 09:20:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:20:41,252 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:25:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:20:42,908 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:52 UTC)" (scheduled at 2022-11-28 09:20:42.901291+00:00) notificationworker stdout | 2022-11-28 09:20:42,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:20:52 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:20:45,147 [245] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:20:45,152 [245] [INFO] [gunicorn.access] - - [28/Nov/2022:09:20:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:20:45 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.032 1688 0.032) securityworker stdout | 2022-11-28 09:20:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:15 UTC)" (scheduled at 2022-11-28 09:20:45.911636+00:00) securityworker stdout | 2022-11-28 09:20:45,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:20:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:17 UTC)" (scheduled at 2022-11-28 09:20:47.016425+00:00) gcworker stdout | 2022-11-28 09:20:47,077 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:20:48,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:25:48 UTC)" (scheduled at 2022-11-28 09:20:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:20:48,095 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:25:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:20:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:50 UTC)" (scheduled at 2022-11-28 09:20:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:20:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:20:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:51 UTC)" (scheduled at 2022-11-28 09:20:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:20:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:20:52,909 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:02 UTC)" (scheduled at 2022-11-28 09:20:52.901291+00:00) notificationworker stdout | 2022-11-28 09:20:52,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:20:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:23 UTC)" (scheduled at 2022-11-28 09:20:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:20:53,165 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:20:54,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:20:54,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:20:54,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:20:54,510 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:20:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:20:54,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:20:54,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:20:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:20:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-registry stdout | 2022-11-28 09:20:55,203 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:20:55,205 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:09:20:55 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:20:55 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.031 1688 0.031) securityscanningnotificationworker stdout | 2022-11-28 09:20:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:56 UTC)" (scheduled at 2022-11-28 09:20:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:20:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:20:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:57 UTC)" (scheduled at 2022-11-28 09:20:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:20:57,566 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:21:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:21:02,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:12 UTC)" (scheduled at 2022-11-28 09:21:02.901291+00:00) notificationworker stdout | 2022-11-28 09:21:02,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:21:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:03 UTC)" (scheduled at 2022-11-28 09:21:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:21:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:21:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:06 UTC)" (scheduled at 2022-11-28 09:21:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:21:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:21:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:37 UTC)" (scheduled at 2022-11-28 09:21:07.716126+00:00) securityworker stdout | 2022-11-28 09:21:07,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:21:07,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:21:07,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:21:09,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:21:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:21:09,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:21:09,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:21:09,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:21:09,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:09,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 09:21:09,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.093) gunicorn-registry stdout | 2022-11-28 09:21:10,240 [240] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:21:10,241 [240] [INFO] [gunicorn.access] - - [28/Nov/2022:09:21:10 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:21:10 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.019 1688 0.019) notificationworker stdout | 2022-11-28 09:21:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:22 UTC)" (scheduled at 2022-11-28 09:21:12.901291+00:00) notificationworker stdout | 2022-11-28 09:21:12,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:21:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:15 UTC)" (scheduled at 2022-11-28 09:21:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:21:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:21:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:45 UTC)" (scheduled at 2022-11-28 09:21:15.911636+00:00) securityworker stdout | 2022-11-28 09:21:15,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:21:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:47 UTC)" (scheduled at 2022-11-28 09:21:17.016425+00:00) gcworker stdout | 2022-11-28 09:21:17,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:21:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:32 UTC)" (scheduled at 2022-11-28 09:21:22.901291+00:00) notificationworker stdout | 2022-11-28 09:21:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:21:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:53 UTC)" (scheduled at 2022-11-28 09:21:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:21:23,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:21:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.006) gunicorn-registry stdout | 2022-11-28 09:21:24,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:21:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-web stdout | 2022-11-28 09:21:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:21:24,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:24,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:21:24,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:24,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.091) gunicorn-web stdout | 2022-11-28 09:21:24,563 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-registry stdout | 2022-11-28 09:21:30,288 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:21:30,290 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:21:30 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:21:30 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.030 1688 0.031) notificationworker stdout | 2022-11-28 09:21:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:42 UTC)" (scheduled at 2022-11-28 09:21:32.901291+00:00) notificationworker stdout | 2022-11-28 09:21:32,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:21:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:33 UTC)" (scheduled at 2022-11-28 09:21:33.026570+00:00) notificationworker stdout | 2022-11-28 09:21:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:21:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:33 UTC)" (scheduled at 2022-11-28 09:21:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:21:33,344 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:21:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:07 UTC)" (scheduled at 2022-11-28 09:21:37.716126+00:00) securityworker stdout | 2022-11-28 09:21:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:21:37,767 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:21:37,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 09:21:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:21:39,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:21:39,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:21:39,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:21:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:39,566 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 09:21:39,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" blobuploadcleanupworker stdout | 2022-11-28 09:21:40,533 [58] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 10:21:40 UTC)" (scheduled at 2022-11-28 09:21:40.531944+00:00) blobuploadcleanupworker stdout | 2022-11-28 09:21:40,544 [58] [INFO] [redis_lock.acquire] Got lock for 'lock:BLOB_CLEANUP'. blobuploadcleanupworker stdout | 2022-11-28 09:21:40,593 [58] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2022-11-28 10:21:40 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:21:42,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:52 UTC)" (scheduled at 2022-11-28 09:21:42.901291+00:00) notificationworker stdout | 2022-11-28 09:21:42,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:21:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:21:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:15 UTC)" (scheduled at 2022-11-28 09:21:45.911636+00:00) securityworker stdout | 2022-11-28 09:21:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:21:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:17 UTC)" (scheduled at 2022-11-28 09:21:47.016425+00:00) gcworker stdout | 2022-11-28 09:21:47,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:21:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:50 UTC)" (scheduled at 2022-11-28 09:21:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:21:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:21:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:51 UTC)" (scheduled at 2022-11-28 09:21:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:21:51,853 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:21:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:02 UTC)" (scheduled at 2022-11-28 09:21:52.901291+00:00) notificationworker stdout | 2022-11-28 09:21:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:21:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:23 UTC)" (scheduled at 2022-11-28 09:21:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:21:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:21:54,485 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:21:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:21:54,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:21:54,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 09:21:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:21:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:21:54,543 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:21:54,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:21:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:21:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) securityscanningnotificationworker stdout | 2022-11-28 09:21:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:56 UTC)" (scheduled at 2022-11-28 09:21:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:21:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:21:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:57 UTC)" (scheduled at 2022-11-28 09:21:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:21:57,672 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:22:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:22:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:12 UTC)" (scheduled at 2022-11-28 09:22:02.901291+00:00) notificationworker stdout | 2022-11-28 09:22:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:22:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:03 UTC)" (scheduled at 2022-11-28 09:22:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:22:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:22:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:06 UTC)" (scheduled at 2022-11-28 09:22:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:22:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:22:07,721 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:37 UTC)" (scheduled at 2022-11-28 09:22:07.716126+00:00) securityworker stdout | 2022-11-28 09:22:07,736 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:22:07,836 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:22:07,837 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:22:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:22:09,502 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:09,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:22:09,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:22:09,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:09,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 09:22:09,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 09:22:09,597 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:22:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:22 UTC)" (scheduled at 2022-11-28 09:22:12.901291+00:00) notificationworker stdout | 2022-11-28 09:22:12,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:22:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:15 UTC)" (scheduled at 2022-11-28 09:22:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:22:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:22:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:45 UTC)" (scheduled at 2022-11-28 09:22:15.911636+00:00) securityworker stdout | 2022-11-28 09:22:15,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:22:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:47 UTC)" (scheduled at 2022-11-28 09:22:17.016425+00:00) gcworker stdout | 2022-11-28 09:22:17,100 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:22:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:32 UTC)" (scheduled at 2022-11-28 09:22:22.901291+00:00) notificationworker stdout | 2022-11-28 09:22:22,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:22:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:53 UTC)" (scheduled at 2022-11-28 09:22:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:22:23,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:22:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:22:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:22:24,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:22:24,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:24,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:22:24,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:24,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:22:24,564 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 09:22:24,577 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) notificationworker stdout | 2022-11-28 09:22:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:42 UTC)" (scheduled at 2022-11-28 09:22:32.901291+00:00) notificationworker stdout | 2022-11-28 09:22:32,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:22:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:33 UTC)" (scheduled at 2022-11-28 09:22:33.026570+00:00) notificationworker stdout | 2022-11-28 09:22:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:22:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:33 UTC)" (scheduled at 2022-11-28 09:22:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:22:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:22:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:07 UTC)" (scheduled at 2022-11-28 09:22:37.716126+00:00) securityworker stdout | 2022-11-28 09:22:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:22:37,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:22:37,761 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:22:39,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:22:39,491 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:39,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:22:39,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:22:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:22:39,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 09:22:39,534 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:22:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:52 UTC)" (scheduled at 2022-11-28 09:22:42.901291+00:00) notificationworker stdout | 2022-11-28 09:22:42,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:22:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:22:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:15 UTC)" (scheduled at 2022-11-28 09:22:45.911636+00:00) securityworker stdout | 2022-11-28 09:22:46,012 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:22:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:17 UTC)" (scheduled at 2022-11-28 09:22:47.016425+00:00) gcworker stdout | 2022-11-28 09:22:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:22:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:50 UTC)" (scheduled at 2022-11-28 09:22:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:22:50,192 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:22:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:51 UTC)" (scheduled at 2022-11-28 09:22:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:22:51,786 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:22:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:02 UTC)" (scheduled at 2022-11-28 09:22:52.901291+00:00) notificationworker stdout | 2022-11-28 09:22:53,077 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:22:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:23 UTC)" (scheduled at 2022-11-28 09:22:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:22:53,198 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.001) gunicorn-registry stdout | 2022-11-28 09:22:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:22:54,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:54,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:22:54,499 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:22:54,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:22:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:22:54,578 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.105 118 0.105) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:22:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.113 118 0.113) gunicorn-web stdout | 2022-11-28 09:22:54,586 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:22:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:22:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:56 UTC)" (scheduled at 2022-11-28 09:22:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:22:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:22:57,517 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:57 UTC)" (scheduled at 2022-11-28 09:22:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:22:57,586 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:23:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:23:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:12 UTC)" (scheduled at 2022-11-28 09:23:02.901291+00:00) notificationworker stdout | 2022-11-28 09:23:02,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:23:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:03 UTC)" (scheduled at 2022-11-28 09:23:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:23:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:23:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:06 UTC)" (scheduled at 2022-11-28 09:23:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:23:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:23:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:37 UTC)" (scheduled at 2022-11-28 09:23:07.716126+00:00) securityworker stdout | 2022-11-28 09:23:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:23:07,824 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:23:07,825 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:23:09,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 09:23:09,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:09,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:23:09,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:09,525 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:23:09,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) gunicorn-web stdout | 2022-11-28 09:23:09,564 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:23:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:22 UTC)" (scheduled at 2022-11-28 09:23:12.901291+00:00) notificationworker stdout | 2022-11-28 09:23:12,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:23:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:15 UTC)" (scheduled at 2022-11-28 09:23:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:23:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:23:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:45 UTC)" (scheduled at 2022-11-28 09:23:15.911636+00:00) securityworker stdout | 2022-11-28 09:23:16,011 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:23:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:47 UTC)" (scheduled at 2022-11-28 09:23:17.016425+00:00) gcworker stdout | 2022-11-28 09:23:17,175 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:23:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:32 UTC)" (scheduled at 2022-11-28 09:23:22.901291+00:00) notificationworker stdout | 2022-11-28 09:23:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:23:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:53 UTC)" (scheduled at 2022-11-28 09:23:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:23:23,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:23:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:23:24,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:23:24,502 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:23:24,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:24,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:24,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:23:24,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.176 118 0.176) gunicorn-web stdout | 2022-11-28 09:23:24,648 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.187 118 0.187) gunicorn-web stdout | 2022-11-28 09:23:24,659 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:23:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:42 UTC)" (scheduled at 2022-11-28 09:23:32.901291+00:00) notificationworker stdout | 2022-11-28 09:23:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:33 UTC)" (scheduled at 2022-11-28 09:23:33.026570+00:00) notificationworker stdout | 2022-11-28 09:23:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:33 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:23:33,124 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:42 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:23:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:33 UTC)" (scheduled at 2022-11-28 09:23:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:23:33,399 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:23:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:07 UTC)" (scheduled at 2022-11-28 09:23:37.716126+00:00) securityworker stdout | 2022-11-28 09:23:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:23:37,847 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:23:37,847 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:23:38,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:28:38 UTC)" (scheduled at 2022-11-28 09:23:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:23:38,555 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:28:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:23:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:23:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:23:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:23:39,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:23:39,633 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.162 118 0.162) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.165 118 0.165) gunicorn-web stdout | 2022-11-28 09:23:39,637 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:23:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:52 UTC)" (scheduled at 2022-11-28 09:23:42.901291+00:00) notificationworker stdout | 2022-11-28 09:23:42,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:23:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:23:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:15 UTC)" (scheduled at 2022-11-28 09:23:45.911636+00:00) securityworker stdout | 2022-11-28 09:23:45,989 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:23:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:17 UTC)" (scheduled at 2022-11-28 09:23:47.016425+00:00) gcworker stdout | 2022-11-28 09:23:47,074 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:23:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:28:49 UTC)" (scheduled at 2022-11-28 09:23:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:23:49,570 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:28:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:23:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:50 UTC)" (scheduled at 2022-11-28 09:23:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:23:50,334 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:23:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:51 UTC)" (scheduled at 2022-11-28 09:23:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:23:51,817 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:23:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:02 UTC)" (scheduled at 2022-11-28 09:23:52.901291+00:00) notificationworker stdout | 2022-11-28 09:23:53,008 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:23:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:23 UTC)" (scheduled at 2022-11-28 09:23:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:23:53,232 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:23:54,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:23:54,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:23:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 09:23:54,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:23:54,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:23:54,578 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:23:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) gunicorn-web stdout | 2022-11-28 09:23:54,579 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:23:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:23:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:56 UTC)" (scheduled at 2022-11-28 09:23:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:23:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:23:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:57 UTC)" (scheduled at 2022-11-28 09:23:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:23:57,598 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:24:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:24:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:12 UTC)" (scheduled at 2022-11-28 09:24:02.901291+00:00) notificationworker stdout | 2022-11-28 09:24:02,964 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:24:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:03 UTC)" (scheduled at 2022-11-28 09:24:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:24:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:24:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:06 UTC)" (scheduled at 2022-11-28 09:24:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:24:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:24:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:37 UTC)" (scheduled at 2022-11-28 09:24:07.716126+00:00) securityworker stdout | 2022-11-28 09:24:07,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:24:07,800 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:24:07,801 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:24:09,502 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:24:09,503 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.018 162 0.018) gunicorn-web stdout | 2022-11-28 09:24:09,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:24:09,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:24:09,517 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:09,520 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:24:09,597 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.206 118 0.206) gunicorn-web stdout | 2022-11-28 09:24:09,678 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:24:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:22 UTC)" (scheduled at 2022-11-28 09:24:12.901291+00:00) notificationworker stdout | 2022-11-28 09:24:12,975 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:24:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:15 UTC)" (scheduled at 2022-11-28 09:24:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:24:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:24:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:45 UTC)" (scheduled at 2022-11-28 09:24:15.911636+00:00) securityworker stdout | 2022-11-28 09:24:15,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:24:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:47 UTC)" (scheduled at 2022-11-28 09:24:17.016425+00:00) gcworker stdout | 2022-11-28 09:24:17,064 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:24:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:32 UTC)" (scheduled at 2022-11-28 09:24:22.901291+00:00) notificationworker stdout | 2022-11-28 09:24:22,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:24:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:53 UTC)" (scheduled at 2022-11-28 09:24:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:24:23,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:24:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:24:24,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:24:24,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:24:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:24:24,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:24,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 09:24:24,562 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 09:24:24,579 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:24:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:42 UTC)" (scheduled at 2022-11-28 09:24:32.901291+00:00) notificationworker stdout | 2022-11-28 09:24:32,972 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:24:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:33 UTC)" (scheduled at 2022-11-28 09:24:33.026570+00:00) notificationworker stdout | 2022-11-28 09:24:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:24:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:33 UTC)" (scheduled at 2022-11-28 09:24:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:24:33,384 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:24:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:07 UTC)" (scheduled at 2022-11-28 09:24:37.716126+00:00) securityworker stdout | 2022-11-28 09:24:37,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:24:37,795 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:24:37,796 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:24:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:29:38 UTC)" (scheduled at 2022-11-28 09:24:38.024004+00:00) notificationworker stdout | 2022-11-28 09:24:38,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:29:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:24:39,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.019 162 0.019) gunicorn-registry stdout | 2022-11-28 09:24:39,508 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:39,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:24:39,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:24:39,523 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:39,526 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:24:39,592 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.129) gunicorn-web stdout | 2022-11-28 09:24:39,600 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:24:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:52 UTC)" (scheduled at 2022-11-28 09:24:42.901291+00:00) notificationworker stdout | 2022-11-28 09:24:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:24:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:24:45,916 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:15 UTC)" (scheduled at 2022-11-28 09:24:45.911636+00:00) securityworker stdout | 2022-11-28 09:24:46,025 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:24:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:17 UTC)" (scheduled at 2022-11-28 09:24:47.016425+00:00) gcworker stdout | 2022-11-28 09:24:47,155 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:24:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:50 UTC)" (scheduled at 2022-11-28 09:24:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:24:50,182 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:24:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:51 UTC)" (scheduled at 2022-11-28 09:24:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:24:51,775 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:24:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:02 UTC)" (scheduled at 2022-11-28 09:24:52.901291+00:00) notificationworker stdout | 2022-11-28 09:24:52,991 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:24:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:23 UTC)" (scheduled at 2022-11-28 09:24:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:24:53,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:24:54,492 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:24:54,497 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:24:54,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 159 0.014) gunicorn-web stdout | 2022-11-28 09:24:54,523 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:24:54,525 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:24:54,670 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.199 118 0.200) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:24:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.243 118 0.243) gunicorn-web stdout | 2022-11-28 09:24:54,716 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:24:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:24:56,165 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:56 UTC)" (scheduled at 2022-11-28 09:24:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:24:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:24:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:57 UTC)" (scheduled at 2022-11-28 09:24:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:24:57,585 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:25:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:25:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:12 UTC)" (scheduled at 2022-11-28 09:25:02.901291+00:00) notificationworker stdout | 2022-11-28 09:25:02,982 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:25:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:03 UTC)" (scheduled at 2022-11-28 09:25:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:25:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:25:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:06 UTC)" (scheduled at 2022-11-28 09:25:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:25:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:25:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:37 UTC)" (scheduled at 2022-11-28 09:25:07.716126+00:00) securityworker stdout | 2022-11-28 09:25:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:25:07,785 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:25:07,786 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:25:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:25:09,495 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:25:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:25:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 09:25:09,541 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:25:09,543 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 09:25:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:22 UTC)" (scheduled at 2022-11-28 09:25:12.901291+00:00) notificationworker stdout | 2022-11-28 09:25:12,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:25:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:15 UTC)" (scheduled at 2022-11-28 09:25:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:25:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:25:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:45 UTC)" (scheduled at 2022-11-28 09:25:15.911636+00:00) securityworker stdout | 2022-11-28 09:25:15,951 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:25:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:47 UTC)" (scheduled at 2022-11-28 09:25:17.016425+00:00) gcworker stdout | 2022-11-28 09:25:17,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:25:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:32 UTC)" (scheduled at 2022-11-28 09:25:22.901291+00:00) notificationworker stdout | 2022-11-28 09:25:23,025 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:25:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:53 UTC)" (scheduled at 2022-11-28 09:25:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:25:23,206 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:25:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:25:24,508 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.021 162 0.021) gunicorn-registry stdout | 2022-11-28 09:25:24,513 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:24,526 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:24,527 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.006) gunicorn-web stdout | 2022-11-28 09:25:24,534 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:25:24,539 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.181 118 0.181) gunicorn-web stdout | 2022-11-28 09:25:24,657 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.199 118 0.199) gunicorn-web stdout | 2022-11-28 09:25:24,674 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:25:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:42 UTC)" (scheduled at 2022-11-28 09:25:32.901291+00:00) notificationworker stdout | 2022-11-28 09:25:32,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:25:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:33 UTC)" (scheduled at 2022-11-28 09:25:33.026570+00:00) notificationworker stdout | 2022-11-28 09:25:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:25:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:33 UTC)" (scheduled at 2022-11-28 09:25:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:25:33,366 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:25:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:07 UTC)" (scheduled at 2022-11-28 09:25:37.716126+00:00) securityworker stdout | 2022-11-28 09:25:37,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:25:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:25:37,802 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:25:39,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:25:39,492 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:25:39,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:25:39,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:25:39,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:25:39,555 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 09:25:39,563 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) securityscanningnotificationworker stdout | 2022-11-28 09:25:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:30:41 UTC)" (scheduled at 2022-11-28 09:25:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:25:41,210 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:30:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:25:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:52 UTC)" (scheduled at 2022-11-28 09:25:42.901291+00:00) notificationworker stdout | 2022-11-28 09:25:43,048 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:25:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:25:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:15 UTC)" (scheduled at 2022-11-28 09:25:45.911636+00:00) securityworker stdout | 2022-11-28 09:25:46,002 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:25:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:17 UTC)" (scheduled at 2022-11-28 09:25:47.016425+00:00) gcworker stdout | 2022-11-28 09:25:47,087 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:25:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:30:48 UTC)" (scheduled at 2022-11-28 09:25:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:25:48,085 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:30:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:25:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:50 UTC)" (scheduled at 2022-11-28 09:25:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:25:50,211 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:25:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:51 UTC)" (scheduled at 2022-11-28 09:25:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:25:51,795 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:25:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:02 UTC)" (scheduled at 2022-11-28 09:25:52.901291+00:00) notificationworker stdout | 2022-11-28 09:25:52,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:25:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:23 UTC)" (scheduled at 2022-11-28 09:25:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:25:53,179 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) gunicorn-registry stdout | 2022-11-28 09:25:54,493 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:25:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:25:54,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:25:54,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:25:54,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.135 118 0.135) gunicorn-web stdout | 2022-11-28 09:25:54,607 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:25:54,610 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:25:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:25:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) securityscanningnotificationworker stdout | 2022-11-28 09:25:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:56 UTC)" (scheduled at 2022-11-28 09:25:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:25:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:25:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:57 UTC)" (scheduled at 2022-11-28 09:25:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:25:57,605 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:26:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:26:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:12 UTC)" (scheduled at 2022-11-28 09:26:02.901291+00:00) notificationworker stdout | 2022-11-28 09:26:03,063 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:26:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:03 UTC)" (scheduled at 2022-11-28 09:26:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:26:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:26:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:06 UTC)" (scheduled at 2022-11-28 09:26:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:26:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:26:07,726 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:37 UTC)" (scheduled at 2022-11-28 09:26:07.716126+00:00) securityworker stdout | 2022-11-28 09:26:07,763 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:26:07,823 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:26:07,823 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:26:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:26:09,496 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:26:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:26:09,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:09,510 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:26:09,589 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 09:26:09,612 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.141 118 0.141) notificationworker stdout | 2022-11-28 09:26:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:22 UTC)" (scheduled at 2022-11-28 09:26:12.901291+00:00) notificationworker stdout | 2022-11-28 09:26:12,988 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:26:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:15 UTC)" (scheduled at 2022-11-28 09:26:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:26:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:26:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:45 UTC)" (scheduled at 2022-11-28 09:26:15.911636+00:00) securityworker stdout | 2022-11-28 09:26:15,986 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:26:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:47 UTC)" (scheduled at 2022-11-28 09:26:17.016425+00:00) gcworker stdout | 2022-11-28 09:26:17,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:26:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:32 UTC)" (scheduled at 2022-11-28 09:26:22.901291+00:00) notificationworker stdout | 2022-11-28 09:26:22,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:26:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:53 UTC)" (scheduled at 2022-11-28 09:26:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:26:23,179 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:26:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.013) gunicorn-registry stdout | 2022-11-28 09:26:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:26:24,497 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.016) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 09:26:24,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:24,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:26:24,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:26:24,515 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.117) gunicorn-web stdout | 2022-11-28 09:26:24,589 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.119) gunicorn-web stdout | 2022-11-28 09:26:24,593 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:26:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:42 UTC)" (scheduled at 2022-11-28 09:26:32.901291+00:00) notificationworker stdout | 2022-11-28 09:26:32,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:26:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:33 UTC)" (scheduled at 2022-11-28 09:26:33.026570+00:00) notificationworker stdout | 2022-11-28 09:26:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:26:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:33 UTC)" (scheduled at 2022-11-28 09:26:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:26:33,363 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:26:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:07 UTC)" (scheduled at 2022-11-28 09:26:37.716126+00:00) securityworker stdout | 2022-11-28 09:26:37,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:26:37,810 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:26:37,811 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 09:26:39,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.016 162 0.016) gunicorn-registry stdout | 2022-11-28 09:26:39,499 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:39,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.003) gunicorn-web stdout | 2022-11-28 09:26:39,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:26:39,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 09:26:39,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.117) gunicorn-web stdout | 2022-11-28 09:26:39,590 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) gunicorn-web stdout | 2022-11-28 09:26:39,595 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:26:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:52 UTC)" (scheduled at 2022-11-28 09:26:42.901291+00:00) notificationworker stdout | 2022-11-28 09:26:42,974 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:26:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:26:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:15 UTC)" (scheduled at 2022-11-28 09:26:45.911636+00:00) securityworker stdout | 2022-11-28 09:26:46,017 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:26:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:17 UTC)" (scheduled at 2022-11-28 09:26:47.016425+00:00) gcworker stdout | 2022-11-28 09:26:47,130 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:26:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:50 UTC)" (scheduled at 2022-11-28 09:26:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:26:50,183 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:26:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:51 UTC)" (scheduled at 2022-11-28 09:26:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:26:51,858 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:26:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:02 UTC)" (scheduled at 2022-11-28 09:26:52.901291+00:00) notificationworker stdout | 2022-11-28 09:26:53,000 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:26:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:23 UTC)" (scheduled at 2022-11-28 09:26:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:26:53,189 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 09:26:54,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:26:54,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:26:54,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:54,494 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:26:54,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:26:54,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:26:54,608 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:26:54,608 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:26:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:26:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) securityscanningnotificationworker stdout | 2022-11-28 09:26:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:56 UTC)" (scheduled at 2022-11-28 09:26:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:26:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:26:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:57 UTC)" (scheduled at 2022-11-28 09:26:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:26:57,580 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:27:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:27:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:12 UTC)" (scheduled at 2022-11-28 09:27:02.901291+00:00) notificationworker stdout | 2022-11-28 09:27:02,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:27:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:03 UTC)" (scheduled at 2022-11-28 09:27:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:27:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:27:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:06 UTC)" (scheduled at 2022-11-28 09:27:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:27:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:27:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:37 UTC)" (scheduled at 2022-11-28 09:27:07.716126+00:00) securityworker stdout | 2022-11-28 09:27:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:27:07,846 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:27:07,847 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.009) gunicorn-registry stdout | 2022-11-28 09:27:09,493 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:27:09,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:27:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:27:09,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:27:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:27:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.086) gunicorn-web stdout | 2022-11-28 09:27:09,560 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 09:27:09,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:27:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:22 UTC)" (scheduled at 2022-11-28 09:27:12.901291+00:00) notificationworker stdout | 2022-11-28 09:27:13,023 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:27:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:15 UTC)" (scheduled at 2022-11-28 09:27:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:27:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:27:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:45 UTC)" (scheduled at 2022-11-28 09:27:15.911636+00:00) securityworker stdout | 2022-11-28 09:27:16,100 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:27:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:47 UTC)" (scheduled at 2022-11-28 09:27:17.016425+00:00) gcworker stdout | 2022-11-28 09:27:17,137 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:27:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:32 UTC)" (scheduled at 2022-11-28 09:27:22.901291+00:00) notificationworker stdout | 2022-11-28 09:27:22,965 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:27:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:53 UTC)" (scheduled at 2022-11-28 09:27:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:27:23,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:27:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:27:24,492 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:27:24,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:27:24,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:27:24,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:27:24,511 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:24,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:24,633 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.161 118 0.161) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.166 118 0.166) gunicorn-web stdout | 2022-11-28 09:27:24,639 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:27:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:42 UTC)" (scheduled at 2022-11-28 09:27:32.901291+00:00) notificationworker stdout | 2022-11-28 09:27:33,002 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:27:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:33 UTC)" (scheduled at 2022-11-28 09:27:33.026570+00:00) notificationworker stdout | 2022-11-28 09:27:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:27:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:33 UTC)" (scheduled at 2022-11-28 09:27:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:27:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:27:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:07 UTC)" (scheduled at 2022-11-28 09:27:37.716126+00:00) securityworker stdout | 2022-11-28 09:27:37,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:27:37,798 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:27:37,799 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:27:39,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:27:39,496 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:27:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:27:39,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:39,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:27:39,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:39,595 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.123) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) gunicorn-web stdout | 2022-11-28 09:27:39,605 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:27:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:52 UTC)" (scheduled at 2022-11-28 09:27:42.901291+00:00) notificationworker stdout | 2022-11-28 09:27:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:27:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:27:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:15 UTC)" (scheduled at 2022-11-28 09:27:45.911636+00:00) securityworker stdout | 2022-11-28 09:27:46,004 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:27:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:17 UTC)" (scheduled at 2022-11-28 09:27:47.016425+00:00) gcworker stdout | 2022-11-28 09:27:47,099 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:27:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:50 UTC)" (scheduled at 2022-11-28 09:27:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:27:50,252 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:50 UTC)" executed successfully expiredappspecifictokenworker stdout | 2022-11-28 09:27:50,336 [63] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 10:27:50 UTC)" (scheduled at 2022-11-28 09:27:50.334970+00:00) expiredappspecifictokenworker stdout | 2022-11-28 09:27:50,378 [63] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-11-28 10:27:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:27:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:51 UTC)" (scheduled at 2022-11-28 09:27:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:27:51,786 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:27:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:02 UTC)" (scheduled at 2022-11-28 09:27:52.901291+00:00) notificationworker stdout | 2022-11-28 09:27:53,022 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:27:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:23 UTC)" (scheduled at 2022-11-28 09:27:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:27:53,205 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:23 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:27:53 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.125 1709 0.125) gunicorn-registry stdout | 2022-11-28 09:27:53,954 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:27:53 +0000] "HEAD /v2/quayadmin/taashee/blobs/sha256:405fecb6a2fa4f29683f977e7e3b852bf6f8975a2aba647d234d2371894943da HTTP/1.1" 404 0 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:27:54,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:27:54,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:27:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:27:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:27:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:27:54,593 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.119) gunicorn-web stdout | 2022-11-28 09:27:54,601 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:27:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:27:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.130) securityscanningnotificationworker stdout | 2022-11-28 09:27:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:56 UTC)" (scheduled at 2022-11-28 09:27:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:27:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:27:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:57 UTC)" (scheduled at 2022-11-28 09:27:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:27:57,538 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:28:57 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:27:59,339 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:27:59,341 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:27:59 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:27:59 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.051 1688 0.051) notificationworker stdout | 2022-11-28 09:28:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:12 UTC)" (scheduled at 2022-11-28 09:28:02.901291+00:00) notificationworker stdout | 2022-11-28 09:28:02,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:28:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:03 UTC)" (scheduled at 2022-11-28 09:28:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:28:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:28:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:06 UTC)" (scheduled at 2022-11-28 09:28:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:28:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:28:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:37 UTC)" (scheduled at 2022-11-28 09:28:07.716126+00:00) securityworker stdout | 2022-11-28 09:28:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:28:07,818 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:28:07,819 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:28:09,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:28:09,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:28:09,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:09,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:28:09,515 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:09,516 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-registry stdout | 2022-11-28 09:28:09,526 [243] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:28:09,570 [243] [INFO] [gunicorn.access] - - [28/Nov/2022:09:28:09 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.156 1688 0.156) gunicorn-web stdout | 2022-11-28 09:28:09,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.112 118 0.112) gunicorn-web stdout | 2022-11-28 09:28:09,584 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:28:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:22 UTC)" (scheduled at 2022-11-28 09:28:12.901291+00:00) notificationworker stdout | 2022-11-28 09:28:12,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:28:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:15 UTC)" (scheduled at 2022-11-28 09:28:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:28:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:28:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:45 UTC)" (scheduled at 2022-11-28 09:28:15.911636+00:00) securityworker stdout | 2022-11-28 09:28:16,017 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:28:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:47 UTC)" (scheduled at 2022-11-28 09:28:17.016425+00:00) gcworker stdout | 2022-11-28 09:28:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:28:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:32 UTC)" (scheduled at 2022-11-28 09:28:22.901291+00:00) notificationworker stdout | 2022-11-28 09:28:23,035 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:28:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:53 UTC)" (scheduled at 2022-11-28 09:28:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:28:23,197 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:28:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:28:24,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:28:24,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:28:24,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:24,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:28:24,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 09:28:24,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 09:28:24,601 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:28:24,605 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.132 118 0.132) gunicorn-registry stdout | 2022-11-28 09:28:24,660 [247] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:28:24,661 [247] [INFO] [gunicorn.access] - - [28/Nov/2022:09:28:24 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:28:24 +0000] "POST /v2/quayadmin/taashee/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.031 1688 0.033) notificationworker stdout | 2022-11-28 09:28:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:42 UTC)" (scheduled at 2022-11-28 09:28:32.901291+00:00) notificationworker stdout | 2022-11-28 09:28:32,973 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:28:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:33 UTC)" (scheduled at 2022-11-28 09:28:33.026570+00:00) notificationworker stdout | 2022-11-28 09:28:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:28:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:33 UTC)" (scheduled at 2022-11-28 09:28:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:28:33,376 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:28:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:07 UTC)" (scheduled at 2022-11-28 09:28:37.716126+00:00) securityworker stdout | 2022-11-28 09:28:37,769 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:28:37,876 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:28:37,877 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:28:38,421 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:33:38 UTC)" (scheduled at 2022-11-28 09:28:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:28:38,622 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:33:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:28:39,501 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:28:39,506 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:39,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:39,517 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:39,517 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:28:39,518 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:28:39,751 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.274 118 0.274) gunicorn-web stdout | 2022-11-28 09:28:39,752 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.274 118 0.274) notificationworker stdout | 2022-11-28 09:28:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:52 UTC)" (scheduled at 2022-11-28 09:28:42.901291+00:00) notificationworker stdout | 2022-11-28 09:28:42,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:28:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:28:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:15 UTC)" (scheduled at 2022-11-28 09:28:45.911636+00:00) securityworker stdout | 2022-11-28 09:28:45,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:28:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:17 UTC)" (scheduled at 2022-11-28 09:28:47.016425+00:00) gcworker stdout | 2022-11-28 09:28:47,110 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:28:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:33:49 UTC)" (scheduled at 2022-11-28 09:28:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:28:49,511 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:33:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:28:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:50 UTC)" (scheduled at 2022-11-28 09:28:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:28:50,196 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:28:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:51 UTC)" (scheduled at 2022-11-28 09:28:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:28:51,924 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:28:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:02 UTC)" (scheduled at 2022-11-28 09:28:52.901291+00:00) notificationworker stdout | 2022-11-28 09:28:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:28:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:23 UTC)" (scheduled at 2022-11-28 09:28:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:28:53,319 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:28:54,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 09:28:54,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-registry stdout | 2022-11-28 09:28:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:28:54,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:28:54,507 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:28:54,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:28:54,656 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.184 118 0.184) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:28:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.200 118 0.200) gunicorn-web stdout | 2022-11-28 09:28:54,672 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:28:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:28:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:56 UTC)" (scheduled at 2022-11-28 09:28:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:28:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:28:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:57 UTC)" (scheduled at 2022-11-28 09:28:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:28:57,575 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:29:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:29:02,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:12 UTC)" (scheduled at 2022-11-28 09:29:02.901291+00:00) notificationworker stdout | 2022-11-28 09:29:03,087 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:29:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:03 UTC)" (scheduled at 2022-11-28 09:29:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:29:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:29:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:06 UTC)" (scheduled at 2022-11-28 09:29:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:29:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:29:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:37 UTC)" (scheduled at 2022-11-28 09:29:07.716126+00:00) securityworker stdout | 2022-11-28 09:29:07,815 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:29:07,919 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:29:07,920 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:29:09,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.012) gunicorn-registry stdout | 2022-11-28 09:29:09,495 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:29:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:29:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:29:09,753 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.281 118 0.281) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.302 118 0.302) gunicorn-web stdout | 2022-11-28 09:29:09,774 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:29:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:22 UTC)" (scheduled at 2022-11-28 09:29:12.901291+00:00) notificationworker stdout | 2022-11-28 09:29:13,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:29:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:15 UTC)" (scheduled at 2022-11-28 09:29:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:29:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:29:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:45 UTC)" (scheduled at 2022-11-28 09:29:15.911636+00:00) securityworker stdout | 2022-11-28 09:29:15,984 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:29:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:47 UTC)" (scheduled at 2022-11-28 09:29:17.016425+00:00) gcworker stdout | 2022-11-28 09:29:17,081 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:29:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:32 UTC)" (scheduled at 2022-11-28 09:29:22.901291+00:00) notificationworker stdout | 2022-11-28 09:29:22,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:29:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:53 UTC)" (scheduled at 2022-11-28 09:29:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:29:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:29:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:29:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:29:24,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:24,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:29:24,498 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:29:24,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:24,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:29:24,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 09:29:24,577 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:29:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:42 UTC)" (scheduled at 2022-11-28 09:29:32.901291+00:00) notificationworker stdout | 2022-11-28 09:29:32,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:29:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:33 UTC)" (scheduled at 2022-11-28 09:29:33.026570+00:00) notificationworker stdout | 2022-11-28 09:29:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:29:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:33 UTC)" (scheduled at 2022-11-28 09:29:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:29:33,383 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:29:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:07 UTC)" (scheduled at 2022-11-28 09:29:37.716126+00:00) securityworker stdout | 2022-11-28 09:29:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:29:37,818 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:29:37,819 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:29:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:34:38 UTC)" (scheduled at 2022-11-28 09:29:38.024004+00:00) notificationworker stdout | 2022-11-28 09:29:38,172 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:34:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:29:39,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:29:39,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:29:39,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:29:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:29:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:29:39,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:29:39,559 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 09:29:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:52 UTC)" (scheduled at 2022-11-28 09:29:42.901291+00:00) notificationworker stdout | 2022-11-28 09:29:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:29:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:29:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:15 UTC)" (scheduled at 2022-11-28 09:29:45.911636+00:00) securityworker stdout | 2022-11-28 09:29:45,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:29:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:17 UTC)" (scheduled at 2022-11-28 09:29:47.016425+00:00) gcworker stdout | 2022-11-28 09:29:47,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:29:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:50 UTC)" (scheduled at 2022-11-28 09:29:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:29:50,171 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:29:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:51 UTC)" (scheduled at 2022-11-28 09:29:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:29:51,778 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:29:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:02 UTC)" (scheduled at 2022-11-28 09:29:52.901291+00:00) notificationworker stdout | 2022-11-28 09:29:52,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:29:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:23 UTC)" (scheduled at 2022-11-28 09:29:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:29:53,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:29:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:29:54,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:29:54,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:29:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:29:54,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:29:54,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.134) gunicorn-web stdout | 2022-11-28 09:29:54,610 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:29:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.165 118 0.165) gunicorn-web stdout | 2022-11-28 09:29:54,639 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:29:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:29:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:56 UTC)" (scheduled at 2022-11-28 09:29:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:29:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:29:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:57 UTC)" (scheduled at 2022-11-28 09:29:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:29:57,616 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:30:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:30:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:12 UTC)" (scheduled at 2022-11-28 09:30:02.901291+00:00) notificationworker stdout | 2022-11-28 09:30:02,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:30:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:03 UTC)" (scheduled at 2022-11-28 09:30:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:30:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:30:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:06 UTC)" (scheduled at 2022-11-28 09:30:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:30:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:30:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:37 UTC)" (scheduled at 2022-11-28 09:30:07.716126+00:00) securityworker stdout | 2022-11-28 09:30:07,765 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:30:07,836 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:30:07,837 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:30:09,488 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:30:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:30:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:30:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:30:09,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 09:30:09,569 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:30:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:22 UTC)" (scheduled at 2022-11-28 09:30:12.901291+00:00) notificationworker stdout | 2022-11-28 09:30:12,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:22 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:30:13,236 [240] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:09:30:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:30:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.015 544 0.015) nginx stdout | 10.131.0.1 (-) - quayadmin [28/Nov/2022:09:30:13 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%2Fnew1%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1094 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.702 746 0.702) gunicorn-registry stdout | 2022-11-28 09:30:13,979 [240] [INFO] [gunicorn.access] 10.131.0.1 - quayadmin [28/Nov/2022:09:30:13 +0000] "GET /v2/auth?account=quayadmin&scope=repository%3Aquayadmin%2Ftaashee%2Fnew1%3Apush%2Cpull&service=quay-registry-quay-openshift-operators.apps.ocp4.taashee.com HTTP/1.1" 200 1094 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \(linux\))" gunicorn-registry stdout | 2022-11-28 09:30:14,489 [242] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/new1/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:30:14,494 [242] [INFO] [gunicorn.access] - - [28/Nov/2022:09:30:14 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:30:14 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.321 1706 0.321) exportactionlogsworker stdout | 2022-11-28 09:30:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:15 UTC)" (scheduled at 2022-11-28 09:30:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:30:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:30:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:45 UTC)" (scheduled at 2022-11-28 09:30:15.911636+00:00) securityworker stdout | 2022-11-28 09:30:15,991 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:30:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:47 UTC)" (scheduled at 2022-11-28 09:30:17.016425+00:00) gcworker stdout | 2022-11-28 09:30:17,078 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:47 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:30:19,967 [242] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/new1/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:30:19,968 [242] [INFO] [gunicorn.access] - - [28/Nov/2022:09:30:19 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:30:19 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.121 1706 0.121) notificationworker stdout | 2022-11-28 09:30:22,909 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:32 UTC)" (scheduled at 2022-11-28 09:30:22.901291+00:00) notificationworker stdout | 2022-11-28 09:30:22,976 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:30:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:53 UTC)" (scheduled at 2022-11-28 09:30:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:30:23,183 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:30:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:30:24,495 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) gunicorn-registry stdout | 2022-11-28 09:30:24,497 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:30:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:24,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:30:24,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:24,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:30:24,585 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) gunicorn-web stdout | 2022-11-28 09:30:24,602 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-registry stdout | 2022-11-28 09:30:30,057 [246] [ERROR] [gunicorn.error] Error handling request /v2/quayadmin/taashee/new1/blobs/uploads/ gunicorn-registry stdout | Traceback (most recent call last): gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 55, in handle gunicorn-registry stdout | self.handle_request(listener_name, req, client, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/ggevent.py", line 127, in handle_request gunicorn-registry stdout | super().handle_request(listener_name, req, sock, addr) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/gunicorn/workers/base_async.py", line 108, in handle_request gunicorn-registry stdout | respiter = self.wsgi(environ, resp.start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2463, in __call__ gunicorn-registry stdout | return self.wsgi_app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ gunicorn-registry stdout | return self.app(environ, start_response) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2449, in wsgi_app gunicorn-registry stdout | response = self.handle_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1866, in handle_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 2446, in wsgi_app gunicorn-registry stdout | response = self.full_dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1951, in full_dispatch_request gunicorn-registry stdout | rv = self.handle_user_exception(e) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1820, in handle_user_exception gunicorn-registry stdout | reraise(exc_type, exc_value, tb) gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise gunicorn-registry stdout | raise value gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1949, in full_dispatch_request gunicorn-registry stdout | rv = self.dispatch_request() gunicorn-registry stdout | File "/usr/local/lib/python3.8/site-packages/flask/app.py", line 1935, in dispatch_request gunicorn-registry stdout | return self.view_functions[rule.endpoint](**req.view_args) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 218, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 91, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/auth/registry_jwt_auth.py", line 177, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/__init__.py", line 143, in wrapped gunicorn-registry stdout | return func(namespace_name, repo_name, *args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 154, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/decorators.py", line 179, in wrapper gunicorn-registry stdout | return func(*args, **kwargs) gunicorn-registry stdout | File "/quay-registry/endpoints/v2/blob.py", line 258, in start_blob_upload gunicorn-registry stdout | blob_uploader = create_blob_upload(repository_ref, storage, _upload_settings()) gunicorn-registry stdout | File "/quay-registry/data/registry_model/blobuploader.py", line 77, in create_blob_upload gunicorn-registry stdout | new_upload_uuid, upload_metadata = storage.initiate_chunked_upload(location_name) gunicorn-registry stdout | File "/quay-registry/storage/distributedstorage.py", line 20, in wrapper gunicorn-registry stdout | storage = self._storages[preferred] gunicorn-registry stdout | KeyError: 'default' gunicorn-registry stdout | 2022-11-28 09:30:30,071 [246] [INFO] [gunicorn.access] - - [28/Nov/2022:09:30:30 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 0 "-" "-" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:09:30:30 +0000] "POST /v2/quayadmin/taashee/new1/blobs/uploads/ HTTP/1.1" 500 141 "-" "docker/20.10.21 go/go1.18.7 git-commit/3056208 kernel/4.18.0-372.26.1.el8_6.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.21 \x5C(linux\x5C))" (0.057 1706 0.057) notificationworker stdout | 2022-11-28 09:30:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:42 UTC)" (scheduled at 2022-11-28 09:30:32.901291+00:00) notificationworker stdout | 2022-11-28 09:30:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:30:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:33 UTC)" (scheduled at 2022-11-28 09:30:33.026570+00:00) notificationworker stdout | 2022-11-28 09:30:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:30:33,325 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:33 UTC)" (scheduled at 2022-11-28 09:30:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:30:33,350 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:30:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:07 UTC)" (scheduled at 2022-11-28 09:30:37.716126+00:00) securityworker stdout | 2022-11-28 09:30:37,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:30:37,796 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:30:37,799 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:30:39,493 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 09:30:39,502 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:30:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:39,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:30:39,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:39,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:30:39,557 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:30:39,559 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:30:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:35:41 UTC)" (scheduled at 2022-11-28 09:30:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:30:41,219 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:35:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:30:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:52 UTC)" (scheduled at 2022-11-28 09:30:42.901291+00:00) notificationworker stdout | 2022-11-28 09:30:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:30:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:30:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:15 UTC)" (scheduled at 2022-11-28 09:30:45.911636+00:00) securityworker stdout | 2022-11-28 09:30:45,951 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:30:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:17 UTC)" (scheduled at 2022-11-28 09:30:47.016425+00:00) gcworker stdout | 2022-11-28 09:30:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:30:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:35:48 UTC)" (scheduled at 2022-11-28 09:30:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:30:48,077 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:35:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:30:50,138 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:50 UTC)" (scheduled at 2022-11-28 09:30:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:30:50,188 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:30:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:51 UTC)" (scheduled at 2022-11-28 09:30:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:30:51,781 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:30:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:02 UTC)" (scheduled at 2022-11-28 09:30:52.901291+00:00) notificationworker stdout | 2022-11-28 09:30:52,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:30:53,128 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:23 UTC)" (scheduled at 2022-11-28 09:30:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:30:53,171 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:30:54,498 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:30:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:30:54,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:54,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:30:54,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.008) gunicorn-web stdout | 2022-11-28 09:30:54,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.097) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:30:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.100) gunicorn-web stdout | 2022-11-28 09:30:54,580 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:30:54,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:30:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:30:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:56 UTC)" (scheduled at 2022-11-28 09:30:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:30:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:30:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:57 UTC)" (scheduled at 2022-11-28 09:30:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:30:57,553 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:31:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:31:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:12 UTC)" (scheduled at 2022-11-28 09:31:02.901291+00:00) notificationworker stdout | 2022-11-28 09:31:02,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:31:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:03 UTC)" (scheduled at 2022-11-28 09:31:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:31:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:31:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:06 UTC)" (scheduled at 2022-11-28 09:31:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:31:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:31:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:37 UTC)" (scheduled at 2022-11-28 09:31:07.716126+00:00) securityworker stdout | 2022-11-28 09:31:07,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:31:07,776 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:31:07,777 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:31:09,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:31:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:31:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:31:09,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:31:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:31:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:31:09,543 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:31:09,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) notificationworker stdout | 2022-11-28 09:31:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:22 UTC)" (scheduled at 2022-11-28 09:31:12.901291+00:00) notificationworker stdout | 2022-11-28 09:31:12,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:31:15,041 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:15 UTC)" (scheduled at 2022-11-28 09:31:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:31:15,041 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:31:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:45 UTC)" (scheduled at 2022-11-28 09:31:15.911636+00:00) securityworker stdout | 2022-11-28 09:31:15,997 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:31:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:47 UTC)" (scheduled at 2022-11-28 09:31:17.016425+00:00) gcworker stdout | 2022-11-28 09:31:17,054 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:31:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:32 UTC)" (scheduled at 2022-11-28 09:31:22.901291+00:00) notificationworker stdout | 2022-11-28 09:31:22,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:31:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:53 UTC)" (scheduled at 2022-11-28 09:31:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:31:23,137 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:31:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:31:24,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:31:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:31:24,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:31:24,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:31:24,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:31:24,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:31:24,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.097) gunicorn-web stdout | 2022-11-28 09:31:24,579 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) notificationworker stdout | 2022-11-28 09:31:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:42 UTC)" (scheduled at 2022-11-28 09:31:32.901291+00:00) notificationworker stdout | 2022-11-28 09:31:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:31:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:33 UTC)" (scheduled at 2022-11-28 09:31:33.026570+00:00) notificationworker stdout | 2022-11-28 09:31:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:31:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:33 UTC)" (scheduled at 2022-11-28 09:31:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:31:33,346 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:31:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:07 UTC)" (scheduled at 2022-11-28 09:31:37.716126+00:00) securityworker stdout | 2022-11-28 09:31:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:31:37,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:31:37,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:31:39,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:31:39,493 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:31:39,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:31:39,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:31:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:31:39,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:31:39,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:31:39,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.080) notificationworker stdout | 2022-11-28 09:31:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:52 UTC)" (scheduled at 2022-11-28 09:31:42.901291+00:00) notificationworker stdout | 2022-11-28 09:31:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:31:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:31:45,919 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:15 UTC)" (scheduled at 2022-11-28 09:31:45.911636+00:00) securityworker stdout | 2022-11-28 09:31:46,026 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:31:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:17 UTC)" (scheduled at 2022-11-28 09:31:47.016425+00:00) gcworker stdout | 2022-11-28 09:31:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:31:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:50 UTC)" (scheduled at 2022-11-28 09:31:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:31:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:31:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:51 UTC)" (scheduled at 2022-11-28 09:31:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:31:51,774 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:31:52,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:02 UTC)" (scheduled at 2022-11-28 09:31:52.901291+00:00) notificationworker stdout | 2022-11-28 09:31:52,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:31:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:23 UTC)" (scheduled at 2022-11-28 09:31:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:31:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 09:31:54,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:31:54,499 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:31:54,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:31:54,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:31:54,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:31:54,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:31:54,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:31:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 09:31:54,566 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:31:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:31:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:56 UTC)" (scheduled at 2022-11-28 09:31:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:31:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:31:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:57 UTC)" (scheduled at 2022-11-28 09:31:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:31:57,551 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:32:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:32:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:12 UTC)" (scheduled at 2022-11-28 09:32:02.901291+00:00) notificationworker stdout | 2022-11-28 09:32:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:32:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:03 UTC)" (scheduled at 2022-11-28 09:32:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:32:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:32:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:06 UTC)" (scheduled at 2022-11-28 09:32:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:32:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:32:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:37 UTC)" (scheduled at 2022-11-28 09:32:07.716126+00:00) securityworker stdout | 2022-11-28 09:32:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:32:07,757 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:32:07,758 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:32:09,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:32:09,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:09,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:32:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:32:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:32:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:32:09,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) gunicorn-web stdout | 2022-11-28 09:32:09,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:32:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:22 UTC)" (scheduled at 2022-11-28 09:32:12.901291+00:00) notificationworker stdout | 2022-11-28 09:32:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:32:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:15 UTC)" (scheduled at 2022-11-28 09:32:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:32:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:32:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:45 UTC)" (scheduled at 2022-11-28 09:32:15.911636+00:00) securityworker stdout | 2022-11-28 09:32:15,949 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:32:17,021 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:47 UTC)" (scheduled at 2022-11-28 09:32:17.016425+00:00) gcworker stdout | 2022-11-28 09:32:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:32:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:32 UTC)" (scheduled at 2022-11-28 09:32:22.901291+00:00) notificationworker stdout | 2022-11-28 09:32:22,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:32:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:53 UTC)" (scheduled at 2022-11-28 09:32:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:32:23,158 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:32:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:32:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:32:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:32:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:32:24,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:24,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:32:24,532 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 09:32:24,531 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:32:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:42 UTC)" (scheduled at 2022-11-28 09:32:32.901291+00:00) notificationworker stdout | 2022-11-28 09:32:32,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:32:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:33 UTC)" (scheduled at 2022-11-28 09:32:33.026570+00:00) notificationworker stdout | 2022-11-28 09:32:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:32:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:33 UTC)" (scheduled at 2022-11-28 09:32:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:32:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:32:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:07 UTC)" (scheduled at 2022-11-28 09:32:37.716126+00:00) securityworker stdout | 2022-11-28 09:32:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:32:37,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:32:37,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:32:39,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:32:39,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:32:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:32:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:32:39,544 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:32:39,544 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) notificationworker stdout | 2022-11-28 09:32:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:52 UTC)" (scheduled at 2022-11-28 09:32:42.901291+00:00) notificationworker stdout | 2022-11-28 09:32:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:32:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:32:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:15 UTC)" (scheduled at 2022-11-28 09:32:45.911636+00:00) securityworker stdout | 2022-11-28 09:32:45,955 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:32:47,021 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:17 UTC)" (scheduled at 2022-11-28 09:32:47.016425+00:00) gcworker stdout | 2022-11-28 09:32:47,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:32:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:50 UTC)" (scheduled at 2022-11-28 09:32:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:32:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:32:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:51 UTC)" (scheduled at 2022-11-28 09:32:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:32:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:32:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:02 UTC)" (scheduled at 2022-11-28 09:32:52.901291+00:00) notificationworker stdout | 2022-11-28 09:32:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:32:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:23 UTC)" (scheduled at 2022-11-28 09:32:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:32:53,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:32:54,498 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.007) gunicorn-registry stdout | 2022-11-28 09:32:54,504 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:32:54,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 159 0.023) gunicorn-web stdout | 2022-11-28 09:32:54,536 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:32:54,540 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.112) gunicorn-web stdout | 2022-11-28 09:32:54,590 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:32:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.121) gunicorn-web stdout | 2022-11-28 09:32:54,599 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:32:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:32:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:56 UTC)" (scheduled at 2022-11-28 09:32:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:32:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:32:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:57 UTC)" (scheduled at 2022-11-28 09:32:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:32:57,563 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:33:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:33:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:12 UTC)" (scheduled at 2022-11-28 09:33:02.901291+00:00) notificationworker stdout | 2022-11-28 09:33:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:33:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:03 UTC)" (scheduled at 2022-11-28 09:33:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:33:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:33:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:06 UTC)" (scheduled at 2022-11-28 09:33:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:33:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:33:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:37 UTC)" (scheduled at 2022-11-28 09:33:07.716126+00:00) securityworker stdout | 2022-11-28 09:33:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:33:07,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:33:07,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:33:09,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:33:09,493 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:33:09,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:33:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:33:09,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:33:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:33:09,548 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:33:09,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:33:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:22 UTC)" (scheduled at 2022-11-28 09:33:12.901291+00:00) notificationworker stdout | 2022-11-28 09:33:12,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:33:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:15 UTC)" (scheduled at 2022-11-28 09:33:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:33:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:33:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:45 UTC)" (scheduled at 2022-11-28 09:33:15.911636+00:00) securityworker stdout | 2022-11-28 09:33:15,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:33:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:47 UTC)" (scheduled at 2022-11-28 09:33:17.016425+00:00) gcworker stdout | 2022-11-28 09:33:17,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:33:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:32 UTC)" (scheduled at 2022-11-28 09:33:22.901291+00:00) notificationworker stdout | 2022-11-28 09:33:22,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:33:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:53 UTC)" (scheduled at 2022-11-28 09:33:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:33:23,152 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:33:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:33:24,482 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:33:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:33:24,491 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:33:24,493 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:33:24,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:33:24,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:33:24,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) gunicorn-web stdout | 2022-11-28 09:33:24,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) notificationworker stdout | 2022-11-28 09:33:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:42 UTC)" (scheduled at 2022-11-28 09:33:32.901291+00:00) notificationworker stdout | 2022-11-28 09:33:32,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:33:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:33 UTC)" (scheduled at 2022-11-28 09:33:33.026570+00:00) notificationworker stdout | 2022-11-28 09:33:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:33:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:33 UTC)" (scheduled at 2022-11-28 09:33:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:33:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:33:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:07 UTC)" (scheduled at 2022-11-28 09:33:37.716126+00:00) securityworker stdout | 2022-11-28 09:33:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:33:37,762 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:33:37,763 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:33:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:38:38 UTC)" (scheduled at 2022-11-28 09:33:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:33:38,458 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:38:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:33:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:33:39,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 09:33:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:33:39,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:33:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:33:39,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:33:39,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:33:39,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:33:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:52 UTC)" (scheduled at 2022-11-28 09:33:42.901291+00:00) notificationworker stdout | 2022-11-28 09:33:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:33:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:33:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:15 UTC)" (scheduled at 2022-11-28 09:33:45.911636+00:00) securityworker stdout | 2022-11-28 09:33:45,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:33:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:17 UTC)" (scheduled at 2022-11-28 09:33:47.016425+00:00) gcworker stdout | 2022-11-28 09:33:47,077 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:33:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:38:49 UTC)" (scheduled at 2022-11-28 09:33:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:33:49,434 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:38:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:33:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:50 UTC)" (scheduled at 2022-11-28 09:33:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:33:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:33:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:51 UTC)" (scheduled at 2022-11-28 09:33:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:33:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:33:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:02 UTC)" (scheduled at 2022-11-28 09:33:52.901291+00:00) notificationworker stdout | 2022-11-28 09:33:52,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:33:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:23 UTC)" (scheduled at 2022-11-28 09:33:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:33:53,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:33:54,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:33:54,501 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:33:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:33:54,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:33:54,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:33:54,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:33:54,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:33:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 09:33:54,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:33:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:33:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:56 UTC)" (scheduled at 2022-11-28 09:33:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:33:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:33:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:57 UTC)" (scheduled at 2022-11-28 09:33:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:33:57,581 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:34:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:34:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:12 UTC)" (scheduled at 2022-11-28 09:34:02.901291+00:00) notificationworker stdout | 2022-11-28 09:34:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:34:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:03 UTC)" (scheduled at 2022-11-28 09:34:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:34:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:34:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:06 UTC)" (scheduled at 2022-11-28 09:34:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:34:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:34:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:37 UTC)" (scheduled at 2022-11-28 09:34:07.716126+00:00) securityworker stdout | 2022-11-28 09:34:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:34:07,753 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:34:07,754 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:34:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:34:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:34:09,497 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:34:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:34:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:34:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.057 118 0.057) gunicorn-web stdout | 2022-11-28 09:34:09,529 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:34:09,529 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.057 118 0.057) notificationworker stdout | 2022-11-28 09:34:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:22 UTC)" (scheduled at 2022-11-28 09:34:12.901291+00:00) notificationworker stdout | 2022-11-28 09:34:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:34:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:15 UTC)" (scheduled at 2022-11-28 09:34:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:34:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:34:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:45 UTC)" (scheduled at 2022-11-28 09:34:15.911636+00:00) securityworker stdout | 2022-11-28 09:34:15,943 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:34:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:47 UTC)" (scheduled at 2022-11-28 09:34:17.016425+00:00) gcworker stdout | 2022-11-28 09:34:17,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:34:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:32 UTC)" (scheduled at 2022-11-28 09:34:22.901291+00:00) notificationworker stdout | 2022-11-28 09:34:22,960 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:34:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:53 UTC)" (scheduled at 2022-11-28 09:34:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:34:23,213 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:34:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:34:24,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:34:24,496 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-web stdout | 2022-11-28 09:34:24,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:34:24,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:34:24,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:34:24,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.138) gunicorn-web stdout | 2022-11-28 09:34:24,611 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:34:24,613 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.140 118 0.141) notificationworker stdout | 2022-11-28 09:34:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:42 UTC)" (scheduled at 2022-11-28 09:34:32.901291+00:00) notificationworker stdout | 2022-11-28 09:34:32,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:34:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:33 UTC)" (scheduled at 2022-11-28 09:34:33.026570+00:00) notificationworker stdout | 2022-11-28 09:34:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:34:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:33 UTC)" (scheduled at 2022-11-28 09:34:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:34:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:34:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:07 UTC)" (scheduled at 2022-11-28 09:34:37.716126+00:00) securityworker stdout | 2022-11-28 09:34:37,731 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:34:37,776 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:34:37,776 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:34:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:39:38 UTC)" (scheduled at 2022-11-28 09:34:38.024004+00:00) notificationworker stdout | 2022-11-28 09:34:38,056 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:39:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:34:39,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:34:39,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:34:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:34:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:34:39,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:34:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 09:34:39,534 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:34:39,536 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) notificationworker stdout | 2022-11-28 09:34:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:52 UTC)" (scheduled at 2022-11-28 09:34:42.901291+00:00) notificationworker stdout | 2022-11-28 09:34:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:34:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:34:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:15 UTC)" (scheduled at 2022-11-28 09:34:45.911636+00:00) securityworker stdout | 2022-11-28 09:34:45,971 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:34:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:17 UTC)" (scheduled at 2022-11-28 09:34:47.016425+00:00) gcworker stdout | 2022-11-28 09:34:47,120 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:34:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:50 UTC)" (scheduled at 2022-11-28 09:34:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:34:50,165 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:34:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:51 UTC)" (scheduled at 2022-11-28 09:34:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:34:51,764 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:34:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:02 UTC)" (scheduled at 2022-11-28 09:34:52.901291+00:00) notificationworker stdout | 2022-11-28 09:34:52,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:34:53,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:23 UTC)" (scheduled at 2022-11-28 09:34:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:34:53,146 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:34:54,487 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:34:54,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:34:54,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:34:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:34:54,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:34:54,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.107) gunicorn-web stdout | 2022-11-28 09:34:54,578 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:34:54,601 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:34:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:34:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) securityscanningnotificationworker stdout | 2022-11-28 09:34:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:56 UTC)" (scheduled at 2022-11-28 09:34:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:34:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:34:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:57 UTC)" (scheduled at 2022-11-28 09:34:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:34:57,549 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:35:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:35:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:12 UTC)" (scheduled at 2022-11-28 09:35:02.901291+00:00) notificationworker stdout | 2022-11-28 09:35:02,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:35:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:03 UTC)" (scheduled at 2022-11-28 09:35:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:35:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:35:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:06 UTC)" (scheduled at 2022-11-28 09:35:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:35:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:35:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:37 UTC)" (scheduled at 2022-11-28 09:35:07.716126+00:00) securityworker stdout | 2022-11-28 09:35:07,753 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:35:07,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:35:07,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:35:09,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:35:09,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:35:09,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:09,496 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:35:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:35:09,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:35:09,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.079) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.079) notificationworker stdout | 2022-11-28 09:35:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:22 UTC)" (scheduled at 2022-11-28 09:35:12.901291+00:00) notificationworker stdout | 2022-11-28 09:35:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:35:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:15 UTC)" (scheduled at 2022-11-28 09:35:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:35:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:35:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:45 UTC)" (scheduled at 2022-11-28 09:35:15.911636+00:00) securityworker stdout | 2022-11-28 09:35:16,001 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:35:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:47 UTC)" (scheduled at 2022-11-28 09:35:17.016425+00:00) gcworker stdout | 2022-11-28 09:35:17,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:35:22,920 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:32 UTC)" (scheduled at 2022-11-28 09:35:22.901291+00:00) notificationworker stdout | 2022-11-28 09:35:22,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:35:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:53 UTC)" (scheduled at 2022-11-28 09:35:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:35:23,191 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:35:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:35:24,501 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:35:24,501 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:24,518 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 09:35:24,520 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 09:35:24,522 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:24,525 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:35:24,631 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.157 118 0.157) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.164 118 0.164) gunicorn-web stdout | 2022-11-28 09:35:24,639 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:35:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:42 UTC)" (scheduled at 2022-11-28 09:35:32.901291+00:00) notificationworker stdout | 2022-11-28 09:35:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:35:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:33 UTC)" (scheduled at 2022-11-28 09:35:33.026570+00:00) notificationworker stdout | 2022-11-28 09:35:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:35:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:33 UTC)" (scheduled at 2022-11-28 09:35:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:35:33,354 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:35:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:07 UTC)" (scheduled at 2022-11-28 09:35:37.716126+00:00) securityworker stdout | 2022-11-28 09:35:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:35:37,804 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:35:37,806 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:35:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:35:39,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:39,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:35:39,517 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:35:39,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:35:39,561 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 09:35:39,571 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) securityscanningnotificationworker stdout | 2022-11-28 09:35:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:40:41 UTC)" (scheduled at 2022-11-28 09:35:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:35:41,195 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:40:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:35:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:52 UTC)" (scheduled at 2022-11-28 09:35:42.901291+00:00) notificationworker stdout | 2022-11-28 09:35:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:35:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:35:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:15 UTC)" (scheduled at 2022-11-28 09:35:45.911636+00:00) securityworker stdout | 2022-11-28 09:35:45,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:35:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:17 UTC)" (scheduled at 2022-11-28 09:35:47.016425+00:00) gcworker stdout | 2022-11-28 09:35:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:35:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:40:48 UTC)" (scheduled at 2022-11-28 09:35:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:35:48,093 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:40:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:35:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:50 UTC)" (scheduled at 2022-11-28 09:35:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:35:50,156 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:35:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:51 UTC)" (scheduled at 2022-11-28 09:35:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:35:51,764 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:35:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:02 UTC)" (scheduled at 2022-11-28 09:35:52.901291+00:00) notificationworker stdout | 2022-11-28 09:35:52,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:35:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:23 UTC)" (scheduled at 2022-11-28 09:35:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:35:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:35:54,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:35:54,492 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:54,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:35:54,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:35:54,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:35:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.076) gunicorn-web stdout | 2022-11-28 09:35:54,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:35:54,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:35:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:35:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) securityscanningnotificationworker stdout | 2022-11-28 09:35:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:56 UTC)" (scheduled at 2022-11-28 09:35:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:35:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:35:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:57 UTC)" (scheduled at 2022-11-28 09:35:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:35:57,553 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:36:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:36:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:12 UTC)" (scheduled at 2022-11-28 09:36:02.901291+00:00) notificationworker stdout | 2022-11-28 09:36:02,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:36:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:03 UTC)" (scheduled at 2022-11-28 09:36:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:36:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:36:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:06 UTC)" (scheduled at 2022-11-28 09:36:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:36:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:36:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:37 UTC)" (scheduled at 2022-11-28 09:36:07.716126+00:00) securityworker stdout | 2022-11-28 09:36:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:36:07,773 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:36:07,774 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:36:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:36:09,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:36:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:36:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:36:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:36:09,531 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) gunicorn-web stdout | 2022-11-28 09:36:09,533 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) notificationworker stdout | 2022-11-28 09:36:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:22 UTC)" (scheduled at 2022-11-28 09:36:12.901291+00:00) notificationworker stdout | 2022-11-28 09:36:12,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:36:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:15 UTC)" (scheduled at 2022-11-28 09:36:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:36:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:36:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:45 UTC)" (scheduled at 2022-11-28 09:36:15.911636+00:00) securityworker stdout | 2022-11-28 09:36:15,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:36:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:47 UTC)" (scheduled at 2022-11-28 09:36:17.016425+00:00) gcworker stdout | 2022-11-28 09:36:17,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:36:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:32 UTC)" (scheduled at 2022-11-28 09:36:22.901291+00:00) notificationworker stdout | 2022-11-28 09:36:22,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:36:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:53 UTC)" (scheduled at 2022-11-28 09:36:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:36:23,148 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:36:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:36:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 09:36:24,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:36:24,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:36:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:24,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:36:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:36:24,553 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:36:24,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) notificationworker stdout | 2022-11-28 09:36:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:42 UTC)" (scheduled at 2022-11-28 09:36:32.901291+00:00) notificationworker stdout | 2022-11-28 09:36:32,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:36:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:33 UTC)" (scheduled at 2022-11-28 09:36:33.026570+00:00) notificationworker stdout | 2022-11-28 09:36:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:36:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:33 UTC)" (scheduled at 2022-11-28 09:36:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:36:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:36:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:07 UTC)" (scheduled at 2022-11-28 09:36:37.716126+00:00) securityworker stdout | 2022-11-28 09:36:37,780 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:36:37,826 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:36:37,827 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:36:39,487 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:36:39,489 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:39,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:39,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:36:39,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:36:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 09:36:39,539 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:36:39,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:36:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:52 UTC)" (scheduled at 2022-11-28 09:36:42.901291+00:00) notificationworker stdout | 2022-11-28 09:36:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:36:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:36:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:15 UTC)" (scheduled at 2022-11-28 09:36:45.911636+00:00) securityworker stdout | 2022-11-28 09:36:45,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:36:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:17 UTC)" (scheduled at 2022-11-28 09:36:47.016425+00:00) gcworker stdout | 2022-11-28 09:36:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:36:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:50 UTC)" (scheduled at 2022-11-28 09:36:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:36:50,176 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:36:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:51 UTC)" (scheduled at 2022-11-28 09:36:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:36:51,759 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:36:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:02 UTC)" (scheduled at 2022-11-28 09:36:52.901291+00:00) notificationworker stdout | 2022-11-28 09:36:52,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:36:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:23 UTC)" (scheduled at 2022-11-28 09:36:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:36:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:36:54,487 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:36:54,494 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:54,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:36:54,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:36:54,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 09:36:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:36:54,546 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 09:36:54,564 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:36:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:36:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.092 118 0.092) securityscanningnotificationworker stdout | 2022-11-28 09:36:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:56 UTC)" (scheduled at 2022-11-28 09:36:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:36:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:36:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:57 UTC)" (scheduled at 2022-11-28 09:36:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:36:57,575 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:37:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:37:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:12 UTC)" (scheduled at 2022-11-28 09:37:02.901291+00:00) notificationworker stdout | 2022-11-28 09:37:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:37:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:03 UTC)" (scheduled at 2022-11-28 09:37:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:37:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:37:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:06 UTC)" (scheduled at 2022-11-28 09:37:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:37:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:37:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:37 UTC)" (scheduled at 2022-11-28 09:37:07.716126+00:00) securityworker stdout | 2022-11-28 09:37:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:37:07,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:37:07,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:37:09,488 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:37:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:37:09,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:37:09,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:09,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:37:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:37:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:37:09,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) notificationworker stdout | 2022-11-28 09:37:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:22 UTC)" (scheduled at 2022-11-28 09:37:12.901291+00:00) notificationworker stdout | 2022-11-28 09:37:12,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:37:15,039 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:15 UTC)" (scheduled at 2022-11-28 09:37:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:37:15,040 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:37:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:45 UTC)" (scheduled at 2022-11-28 09:37:15.911636+00:00) securityworker stdout | 2022-11-28 09:37:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:37:17,023 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:47 UTC)" (scheduled at 2022-11-28 09:37:17.016425+00:00) gcworker stdout | 2022-11-28 09:37:17,094 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:37:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:32 UTC)" (scheduled at 2022-11-28 09:37:22.901291+00:00) notificationworker stdout | 2022-11-28 09:37:22,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:37:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:53 UTC)" (scheduled at 2022-11-28 09:37:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:37:23,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:37:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:37:24,504 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:37:24,515 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:24,516 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:37:24,518 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:37:24,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:37:24,511 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:24,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:37:24,572 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) notificationworker stdout | 2022-11-28 09:37:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:42 UTC)" (scheduled at 2022-11-28 09:37:32.901291+00:00) notificationworker stdout | 2022-11-28 09:37:32,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:37:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:33 UTC)" (scheduled at 2022-11-28 09:37:33.026570+00:00) notificationworker stdout | 2022-11-28 09:37:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:37:33,326 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:33 UTC)" (scheduled at 2022-11-28 09:37:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:37:33,357 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:37:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:07 UTC)" (scheduled at 2022-11-28 09:37:37.716126+00:00) securityworker stdout | 2022-11-28 09:37:37,746 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:37:37,790 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:37:37,791 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:37:39,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:37:39,497 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:39,511 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 09:37:39,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:39,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:37:39,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 09:37:39,547 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:37:39,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:37:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:52 UTC)" (scheduled at 2022-11-28 09:37:42.901291+00:00) notificationworker stdout | 2022-11-28 09:37:42,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:37:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:37:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:15 UTC)" (scheduled at 2022-11-28 09:37:45.911636+00:00) securityworker stdout | 2022-11-28 09:37:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:37:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:17 UTC)" (scheduled at 2022-11-28 09:37:47.016425+00:00) gcworker stdout | 2022-11-28 09:37:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:37:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:50 UTC)" (scheduled at 2022-11-28 09:37:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:37:50,169 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:37:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:51 UTC)" (scheduled at 2022-11-28 09:37:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:37:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:37:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:02 UTC)" (scheduled at 2022-11-28 09:37:52.901291+00:00) notificationworker stdout | 2022-11-28 09:37:52,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:37:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:23 UTC)" (scheduled at 2022-11-28 09:37:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:37:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:37:54,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:37:54,491 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:37:54,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:37:54,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:37:54,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:37:54,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:37:54,541 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:37:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:37:54,556 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:37:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:37:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:56 UTC)" (scheduled at 2022-11-28 09:37:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:37:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:37:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:57 UTC)" (scheduled at 2022-11-28 09:37:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:37:57,542 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:38:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:38:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:12 UTC)" (scheduled at 2022-11-28 09:38:02.901291+00:00) notificationworker stdout | 2022-11-28 09:38:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:38:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:03 UTC)" (scheduled at 2022-11-28 09:38:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:38:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:38:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:06 UTC)" (scheduled at 2022-11-28 09:38:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:38:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:38:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:37 UTC)" (scheduled at 2022-11-28 09:38:07.716126+00:00) securityworker stdout | 2022-11-28 09:38:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:38:07,793 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:38:07,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:38:09,483 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:38:09,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:38:09,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:38:09,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:38:09,497 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:38:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 09:38:09,532 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.063 118 0.063) gunicorn-web stdout | 2022-11-28 09:38:09,535 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:38:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:22 UTC)" (scheduled at 2022-11-28 09:38:12.901291+00:00) notificationworker stdout | 2022-11-28 09:38:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:38:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:15 UTC)" (scheduled at 2022-11-28 09:38:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:38:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:38:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:45 UTC)" (scheduled at 2022-11-28 09:38:15.911636+00:00) securityworker stdout | 2022-11-28 09:38:15,967 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:38:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:47 UTC)" (scheduled at 2022-11-28 09:38:17.016425+00:00) gcworker stdout | 2022-11-28 09:38:17,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:38:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:32 UTC)" (scheduled at 2022-11-28 09:38:22.901291+00:00) notificationworker stdout | 2022-11-28 09:38:22,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:38:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:53 UTC)" (scheduled at 2022-11-28 09:38:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:38:23,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:38:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:38:24,495 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:38:24,497 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 09:38:24,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:38:24,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:38:24,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:38:24,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:38:24,593 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:38:24,593 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) notificationworker stdout | 2022-11-28 09:38:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:42 UTC)" (scheduled at 2022-11-28 09:38:32.901291+00:00) notificationworker stdout | 2022-11-28 09:38:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:38:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:33 UTC)" (scheduled at 2022-11-28 09:38:33.026570+00:00) notificationworker stdout | 2022-11-28 09:38:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:38:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:33 UTC)" (scheduled at 2022-11-28 09:38:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:38:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:38:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:07 UTC)" (scheduled at 2022-11-28 09:38:37.716126+00:00) securityworker stdout | 2022-11-28 09:38:37,742 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:38:37,828 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:38:37,829 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:38:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:43:38 UTC)" (scheduled at 2022-11-28 09:38:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:38:38,458 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:43:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:38:39,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:38:39,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 09:38:39,505 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:38:39,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:38:39,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:38:39,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:38:39,552 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:38:39,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:38:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:52 UTC)" (scheduled at 2022-11-28 09:38:42.901291+00:00) notificationworker stdout | 2022-11-28 09:38:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:38:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:38:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:15 UTC)" (scheduled at 2022-11-28 09:38:45.911636+00:00) securityworker stdout | 2022-11-28 09:38:45,974 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:38:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:17 UTC)" (scheduled at 2022-11-28 09:38:47.016425+00:00) gcworker stdout | 2022-11-28 09:38:47,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:38:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:43:49 UTC)" (scheduled at 2022-11-28 09:38:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:38:49,449 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:43:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:38:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:50 UTC)" (scheduled at 2022-11-28 09:38:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:38:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:38:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:51 UTC)" (scheduled at 2022-11-28 09:38:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:38:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:38:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:02 UTC)" (scheduled at 2022-11-28 09:38:52.901291+00:00) notificationworker stdout | 2022-11-28 09:38:52,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:38:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:23 UTC)" (scheduled at 2022-11-28 09:38:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:38:53,138 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.004) gunicorn-registry stdout | 2022-11-28 09:38:54,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:38:54,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-web stdout | 2022-11-28 09:38:54,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:38:54,514 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:38:54,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:38:54,518 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:38:54,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 09:38:54,575 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:38:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:38:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) securityscanningnotificationworker stdout | 2022-11-28 09:38:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:56 UTC)" (scheduled at 2022-11-28 09:38:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:38:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:38:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:57 UTC)" (scheduled at 2022-11-28 09:38:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:38:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:39:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:39:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:12 UTC)" (scheduled at 2022-11-28 09:39:02.901291+00:00) notificationworker stdout | 2022-11-28 09:39:02,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:39:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:03 UTC)" (scheduled at 2022-11-28 09:39:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:39:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:39:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:06 UTC)" (scheduled at 2022-11-28 09:39:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:39:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:39:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:37 UTC)" (scheduled at 2022-11-28 09:39:07.716126+00:00) securityworker stdout | 2022-11-28 09:39:07,739 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:39:07,785 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:39:07,786 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:37 UTC)" executed successfully manifestbackfillworker stdout | 2022-11-28 09:39:08,422 [72] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 10:39:08 UTC)" (scheduled at 2022-11-28 09:39:08.421529+00:00) manifestbackfillworker stdout | 2022-11-28 09:39:08,451 [72] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-11-28 10:39:08 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:39:09,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.002) gunicorn-registry stdout | 2022-11-28 09:39:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:39:09,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:09,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:39:09,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:39:09,553 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:39:09,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:39:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:22 UTC)" (scheduled at 2022-11-28 09:39:12.901291+00:00) notificationworker stdout | 2022-11-28 09:39:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:39:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:15 UTC)" (scheduled at 2022-11-28 09:39:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:39:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:39:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:45 UTC)" (scheduled at 2022-11-28 09:39:15.911636+00:00) securityworker stdout | 2022-11-28 09:39:15,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:39:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:47 UTC)" (scheduled at 2022-11-28 09:39:17.016425+00:00) gcworker stdout | 2022-11-28 09:39:17,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:39:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:32 UTC)" (scheduled at 2022-11-28 09:39:22.901291+00:00) notificationworker stdout | 2022-11-28 09:39:23,020 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:39:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:53 UTC)" (scheduled at 2022-11-28 09:39:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:39:23,163 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:39:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 09:39:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:39:24,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:39:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:24,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:39:24,513 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:24,515 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 09:39:24,555 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:39:24,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) notificationworker stdout | 2022-11-28 09:39:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:42 UTC)" (scheduled at 2022-11-28 09:39:32.901291+00:00) notificationworker stdout | 2022-11-28 09:39:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:39:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:33 UTC)" (scheduled at 2022-11-28 09:39:33.026570+00:00) notificationworker stdout | 2022-11-28 09:39:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:39:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:33 UTC)" (scheduled at 2022-11-28 09:39:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:39:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:39:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:07 UTC)" (scheduled at 2022-11-28 09:39:37.716126+00:00) securityworker stdout | 2022-11-28 09:39:37,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:39:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:39:37,771 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:39:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:44:38 UTC)" (scheduled at 2022-11-28 09:39:38.024004+00:00) notificationworker stdout | 2022-11-28 09:39:38,073 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:44:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 09:39:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:39:39,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:39:39,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:39,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:39:39,510 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:39:39,512 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:39:39,551 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) gunicorn-web stdout | 2022-11-28 09:39:39,562 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:39:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:52 UTC)" (scheduled at 2022-11-28 09:39:42.901291+00:00) notificationworker stdout | 2022-11-28 09:39:42,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:39:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:39:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:15 UTC)" (scheduled at 2022-11-28 09:39:45.911636+00:00) securityworker stdout | 2022-11-28 09:39:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:39:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:17 UTC)" (scheduled at 2022-11-28 09:39:47.016425+00:00) gcworker stdout | 2022-11-28 09:39:47,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:39:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:50 UTC)" (scheduled at 2022-11-28 09:39:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:39:50,194 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:39:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:51 UTC)" (scheduled at 2022-11-28 09:39:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:39:51,832 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:39:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:02 UTC)" (scheduled at 2022-11-28 09:39:52.901291+00:00) notificationworker stdout | 2022-11-28 09:39:52,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:39:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:23 UTC)" (scheduled at 2022-11-28 09:39:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:39:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 09:39:54,485 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:39:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:39:54,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:39:54,494 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:39:54,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:39:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 09:39:54,597 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:39:54,597 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:39:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:39:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) securityscanningnotificationworker stdout | 2022-11-28 09:39:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:56 UTC)" (scheduled at 2022-11-28 09:39:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:39:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:39:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:57 UTC)" (scheduled at 2022-11-28 09:39:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:39:57,580 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:40:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:40:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:12 UTC)" (scheduled at 2022-11-28 09:40:02.901291+00:00) notificationworker stdout | 2022-11-28 09:40:02,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:40:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:03 UTC)" (scheduled at 2022-11-28 09:40:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:40:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:40:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:06 UTC)" (scheduled at 2022-11-28 09:40:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:40:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:40:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:37 UTC)" (scheduled at 2022-11-28 09:40:07.716126+00:00) securityworker stdout | 2022-11-28 09:40:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:40:07,774 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:40:07,775 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:40:09,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:40:09,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:40:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:09,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:40:09,508 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:40:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 09:40:09,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:40:09,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) notificationworker stdout | 2022-11-28 09:40:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:22 UTC)" (scheduled at 2022-11-28 09:40:12.901291+00:00) notificationworker stdout | 2022-11-28 09:40:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:40:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:15 UTC)" (scheduled at 2022-11-28 09:40:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:40:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:40:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:45 UTC)" (scheduled at 2022-11-28 09:40:15.911636+00:00) securityworker stdout | 2022-11-28 09:40:15,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:40:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:47 UTC)" (scheduled at 2022-11-28 09:40:17.016425+00:00) gcworker stdout | 2022-11-28 09:40:17,096 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:40:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:32 UTC)" (scheduled at 2022-11-28 09:40:22.901291+00:00) notificationworker stdout | 2022-11-28 09:40:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:40:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:53 UTC)" (scheduled at 2022-11-28 09:40:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:40:23,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:40:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:40:24,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 09:40:24,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:24,514 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.026 162 0.026) gunicorn-registry stdout | 2022-11-28 09:40:24,516 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:40:24,538 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:24,541 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.123 118 0.123) gunicorn-web stdout | 2022-11-28 09:40:24,595 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:40:24,623 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.160 118 0.160) notificationworker stdout | 2022-11-28 09:40:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:42 UTC)" (scheduled at 2022-11-28 09:40:32.901291+00:00) notificationworker stdout | 2022-11-28 09:40:32,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:40:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:33 UTC)" (scheduled at 2022-11-28 09:40:33.026570+00:00) notificationworker stdout | 2022-11-28 09:40:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:40:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:33 UTC)" (scheduled at 2022-11-28 09:40:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:40:33,370 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:40:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:07 UTC)" (scheduled at 2022-11-28 09:40:37.716126+00:00) securityworker stdout | 2022-11-28 09:40:37,719 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:40:37,770 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:40:37,770 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:40:39,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:40:39,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:40:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:39,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:40:39,503 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:40:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:40:39,610 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.137 118 0.137) gunicorn-web stdout | 2022-11-28 09:40:39,707 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.235 118 0.235) securityscanningnotificationworker stdout | 2022-11-28 09:40:41,168 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:45:41 UTC)" (scheduled at 2022-11-28 09:40:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:40:41,329 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:45:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:40:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:52 UTC)" (scheduled at 2022-11-28 09:40:42.901291+00:00) notificationworker stdout | 2022-11-28 09:40:42,994 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:40:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:40:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:15 UTC)" (scheduled at 2022-11-28 09:40:45.911636+00:00) securityworker stdout | 2022-11-28 09:40:46,086 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:40:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:17 UTC)" (scheduled at 2022-11-28 09:40:47.016425+00:00) gcworker stdout | 2022-11-28 09:40:47,286 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:40:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:45:48 UTC)" (scheduled at 2022-11-28 09:40:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:40:48,126 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:45:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:40:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:50 UTC)" (scheduled at 2022-11-28 09:40:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:40:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:40:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:51 UTC)" (scheduled at 2022-11-28 09:40:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:40:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:40:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:02 UTC)" (scheduled at 2022-11-28 09:40:52.901291+00:00) notificationworker stdout | 2022-11-28 09:40:52,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:40:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:23 UTC)" (scheduled at 2022-11-28 09:40:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:40:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:40:54,502 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:40:54,503 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:40:54,517 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:54,520 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:40:54,521 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:40:54,525 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:40:54,596 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:40:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.136 118 0.136) gunicorn-web stdout | 2022-11-28 09:40:54,608 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:40:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:40:56,167 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:56 UTC)" (scheduled at 2022-11-28 09:40:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:40:56,167 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:40:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:57 UTC)" (scheduled at 2022-11-28 09:40:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:40:57,612 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:41:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:41:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:12 UTC)" (scheduled at 2022-11-28 09:41:02.901291+00:00) notificationworker stdout | 2022-11-28 09:41:02,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:41:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:03 UTC)" (scheduled at 2022-11-28 09:41:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:41:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:41:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:06 UTC)" (scheduled at 2022-11-28 09:41:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:41:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:41:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:37 UTC)" (scheduled at 2022-11-28 09:41:07.716126+00:00) securityworker stdout | 2022-11-28 09:41:07,746 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:41:07,873 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:41:07,873 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 09:41:09,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:41:09,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:41:09,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:09,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:41:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:41:09,564 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:41:09,580 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) notificationworker stdout | 2022-11-28 09:41:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:22 UTC)" (scheduled at 2022-11-28 09:41:12.901291+00:00) notificationworker stdout | 2022-11-28 09:41:12,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:41:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:15 UTC)" (scheduled at 2022-11-28 09:41:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:41:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:41:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:45 UTC)" (scheduled at 2022-11-28 09:41:15.911636+00:00) securityworker stdout | 2022-11-28 09:41:16,024 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:41:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:47 UTC)" (scheduled at 2022-11-28 09:41:17.016425+00:00) gcworker stdout | 2022-11-28 09:41:17,132 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:41:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:32 UTC)" (scheduled at 2022-11-28 09:41:22.901291+00:00) notificationworker stdout | 2022-11-28 09:41:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:41:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:53 UTC)" (scheduled at 2022-11-28 09:41:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:41:23,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:41:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:41:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:41:24,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:41:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:24,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:41:24,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:24,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.169 118 0.169) gunicorn-web stdout | 2022-11-28 09:41:24,642 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.210 118 0.210) gunicorn-web stdout | 2022-11-28 09:41:24,682 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:41:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:42 UTC)" (scheduled at 2022-11-28 09:41:32.901291+00:00) notificationworker stdout | 2022-11-28 09:41:32,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:41:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:33 UTC)" (scheduled at 2022-11-28 09:41:33.026570+00:00) notificationworker stdout | 2022-11-28 09:41:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:41:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:33 UTC)" (scheduled at 2022-11-28 09:41:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:41:33,372 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:41:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:07 UTC)" (scheduled at 2022-11-28 09:41:37.716126+00:00) securityworker stdout | 2022-11-28 09:41:37,748 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:41:37,816 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:41:37,817 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:41:39,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:41:39,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:41:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:39,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:41:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:41:39,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:41:39,572 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) gunicorn-web stdout | 2022-11-28 09:41:39,583 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:41:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:52 UTC)" (scheduled at 2022-11-28 09:41:42.901291+00:00) notificationworker stdout | 2022-11-28 09:41:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:41:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:41:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:15 UTC)" (scheduled at 2022-11-28 09:41:45.911636+00:00) securityworker stdout | 2022-11-28 09:41:46,078 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:41:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:17 UTC)" (scheduled at 2022-11-28 09:41:47.016425+00:00) gcworker stdout | 2022-11-28 09:41:47,095 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:41:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:50 UTC)" (scheduled at 2022-11-28 09:41:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:41:50,172 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:41:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:51 UTC)" (scheduled at 2022-11-28 09:41:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:41:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:41:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:02 UTC)" (scheduled at 2022-11-28 09:41:52.901291+00:00) notificationworker stdout | 2022-11-28 09:41:52,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:41:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:23 UTC)" (scheduled at 2022-11-28 09:41:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:41:53,208 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:41:54,502 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:41:54,513 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:41:54,525 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:41:54,528 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:41:54,528 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:41:54,532 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:41:54,605 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:41:54,605 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:41:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.129) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:41:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.130 118 0.128) securityscanningnotificationworker stdout | 2022-11-28 09:41:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:56 UTC)" (scheduled at 2022-11-28 09:41:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:41:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:41:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:57 UTC)" (scheduled at 2022-11-28 09:41:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:41:57,580 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:42:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:42:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:12 UTC)" (scheduled at 2022-11-28 09:42:02.901291+00:00) notificationworker stdout | 2022-11-28 09:42:02,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:42:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:03 UTC)" (scheduled at 2022-11-28 09:42:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:42:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:42:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:06 UTC)" (scheduled at 2022-11-28 09:42:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:42:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:42:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:37 UTC)" (scheduled at 2022-11-28 09:42:07.716126+00:00) securityworker stdout | 2022-11-28 09:42:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:42:07,806 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:42:07,809 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:42:09,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:42:09,500 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:42:09,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:09,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:42:09,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:42:09,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:42:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 09:42:09,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.094) notificationworker stdout | 2022-11-28 09:42:12,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:22 UTC)" (scheduled at 2022-11-28 09:42:12.901291+00:00) notificationworker stdout | 2022-11-28 09:42:13,063 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:42:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:15 UTC)" (scheduled at 2022-11-28 09:42:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:42:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:42:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:45 UTC)" (scheduled at 2022-11-28 09:42:15.911636+00:00) securityworker stdout | 2022-11-28 09:42:15,960 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:42:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:47 UTC)" (scheduled at 2022-11-28 09:42:17.016425+00:00) gcworker stdout | 2022-11-28 09:42:17,082 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:42:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:32 UTC)" (scheduled at 2022-11-28 09:42:22.901291+00:00) notificationworker stdout | 2022-11-28 09:42:22,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:42:23,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:53 UTC)" (scheduled at 2022-11-28 09:42:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:42:23,175 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:42:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:42:24,486 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:42:24,490 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:42:24,494 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:42:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:42:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:42:24,547 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 09:42:24,563 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:42:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:42 UTC)" (scheduled at 2022-11-28 09:42:32.901291+00:00) notificationworker stdout | 2022-11-28 09:42:32,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:42:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:33 UTC)" (scheduled at 2022-11-28 09:42:33.026570+00:00) notificationworker stdout | 2022-11-28 09:42:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:42:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:33 UTC)" (scheduled at 2022-11-28 09:42:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:42:33,366 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:42:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:07 UTC)" (scheduled at 2022-11-28 09:42:37.716126+00:00) securityworker stdout | 2022-11-28 09:42:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:42:37,793 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:42:37,794 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:42:39,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:42:39,500 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:42:39,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:42:39,520 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:39,523 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:42:39,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:42:39,560 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 09:42:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:52 UTC)" (scheduled at 2022-11-28 09:42:42.901291+00:00) notificationworker stdout | 2022-11-28 09:42:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:42:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:42:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:15 UTC)" (scheduled at 2022-11-28 09:42:45.911636+00:00) securityworker stdout | 2022-11-28 09:42:45,988 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:42:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:17 UTC)" (scheduled at 2022-11-28 09:42:47.016425+00:00) gcworker stdout | 2022-11-28 09:42:47,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:42:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:50 UTC)" (scheduled at 2022-11-28 09:42:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:42:50,160 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:42:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:51 UTC)" (scheduled at 2022-11-28 09:42:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:42:51,796 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:42:52,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:02 UTC)" (scheduled at 2022-11-28 09:42:52.901291+00:00) notificationworker stdout | 2022-11-28 09:42:52,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:42:53,120 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:23 UTC)" (scheduled at 2022-11-28 09:42:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:42:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:42:54,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:42:54,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:42:54,501 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:42:54,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:42:54,513 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:42:54,586 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:42:54,587 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:42:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:42:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) securityscanningnotificationworker stdout | 2022-11-28 09:42:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:56 UTC)" (scheduled at 2022-11-28 09:42:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:42:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:42:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:57 UTC)" (scheduled at 2022-11-28 09:42:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:42:57,551 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:43:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:43:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:12 UTC)" (scheduled at 2022-11-28 09:43:02.901291+00:00) notificationworker stdout | 2022-11-28 09:43:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:43:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:03 UTC)" (scheduled at 2022-11-28 09:43:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:43:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:43:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:06 UTC)" (scheduled at 2022-11-28 09:43:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:43:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:43:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:37 UTC)" (scheduled at 2022-11-28 09:43:07.716126+00:00) securityworker stdout | 2022-11-28 09:43:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:43:07,768 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:43:07,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:43:09,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:43:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:43:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:43:09,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:43:09,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:43:09,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:43:09,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 09:43:09,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:43:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:22 UTC)" (scheduled at 2022-11-28 09:43:12.901291+00:00) notificationworker stdout | 2022-11-28 09:43:12,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:43:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:15 UTC)" (scheduled at 2022-11-28 09:43:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:43:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:43:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:45 UTC)" (scheduled at 2022-11-28 09:43:15.911636+00:00) securityworker stdout | 2022-11-28 09:43:16,010 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:43:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:47 UTC)" (scheduled at 2022-11-28 09:43:17.016425+00:00) gcworker stdout | 2022-11-28 09:43:17,107 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:43:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:32 UTC)" (scheduled at 2022-11-28 09:43:22.901291+00:00) notificationworker stdout | 2022-11-28 09:43:22,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:43:23,116 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:53 UTC)" (scheduled at 2022-11-28 09:43:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:43:23,161 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:43:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:43:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:43:24,502 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:43:24,517 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 09:43:24,519 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:43:24,520 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:43:24,523 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 09:43:24,574 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) gunicorn-web stdout | 2022-11-28 09:43:24,601 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:43:32,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:42 UTC)" (scheduled at 2022-11-28 09:43:32.901291+00:00) notificationworker stdout | 2022-11-28 09:43:32,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:43:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:33 UTC)" (scheduled at 2022-11-28 09:43:33.026570+00:00) notificationworker stdout | 2022-11-28 09:43:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:43:33,326 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:33 UTC)" (scheduled at 2022-11-28 09:43:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:43:33,360 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:43:37,720 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:07 UTC)" (scheduled at 2022-11-28 09:43:37.716126+00:00) securityworker stdout | 2022-11-28 09:43:37,740 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:43:37,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:43:37,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:43:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:48:38 UTC)" (scheduled at 2022-11-28 09:43:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:43:38,635 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:48:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:43:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:43:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:43:39,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:43:39,513 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.026 162 0.026) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:43:39,528 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:43:39,531 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.124 118 0.124) gunicorn-web stdout | 2022-11-28 09:43:39,595 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.142 118 0.142) gunicorn-web stdout | 2022-11-28 09:43:39,614 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:43:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:52 UTC)" (scheduled at 2022-11-28 09:43:42.901291+00:00) notificationworker stdout | 2022-11-28 09:43:42,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:43:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:43:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:15 UTC)" (scheduled at 2022-11-28 09:43:45.911636+00:00) securityworker stdout | 2022-11-28 09:43:45,961 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:43:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:17 UTC)" (scheduled at 2022-11-28 09:43:47.016425+00:00) gcworker stdout | 2022-11-28 09:43:47,071 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:43:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:48:49 UTC)" (scheduled at 2022-11-28 09:43:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:43:49,467 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:48:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:43:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:50 UTC)" (scheduled at 2022-11-28 09:43:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:43:50,167 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:43:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:51 UTC)" (scheduled at 2022-11-28 09:43:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:43:51,765 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:43:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:02 UTC)" (scheduled at 2022-11-28 09:43:52.901291+00:00) notificationworker stdout | 2022-11-28 09:43:52,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:43:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:23 UTC)" (scheduled at 2022-11-28 09:43:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:43:53,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:43:54,499 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:43:54,509 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:43:54,512 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 159 0.009) gunicorn-web stdout | 2022-11-28 09:43:54,519 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:43:54,520 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:43:54,522 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:43:54,578 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.106 118 0.106) gunicorn-web stdout | 2022-11-28 09:43:54,580 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:43:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:43:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.107 118 0.107) securityscanningnotificationworker stdout | 2022-11-28 09:43:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:56 UTC)" (scheduled at 2022-11-28 09:43:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:43:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:43:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:57 UTC)" (scheduled at 2022-11-28 09:43:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:43:57,603 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:44:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:44:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:12 UTC)" (scheduled at 2022-11-28 09:44:02.901291+00:00) notificationworker stdout | 2022-11-28 09:44:02,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:44:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:03 UTC)" (scheduled at 2022-11-28 09:44:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:44:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:44:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:06 UTC)" (scheduled at 2022-11-28 09:44:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:44:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:44:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:37 UTC)" (scheduled at 2022-11-28 09:44:07.716126+00:00) securityworker stdout | 2022-11-28 09:44:07,754 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:44:07,859 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:44:07,860 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:44:09,493 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:44:09,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:44:09,513 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:44:09,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:09,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:44:09,519 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 09:44:09,591 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:44:09,597 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) notificationworker stdout | 2022-11-28 09:44:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:22 UTC)" (scheduled at 2022-11-28 09:44:12.901291+00:00) notificationworker stdout | 2022-11-28 09:44:12,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:44:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:15 UTC)" (scheduled at 2022-11-28 09:44:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:44:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:44:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:45 UTC)" (scheduled at 2022-11-28 09:44:15.911636+00:00) securityworker stdout | 2022-11-28 09:44:16,025 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:44:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:47 UTC)" (scheduled at 2022-11-28 09:44:17.016425+00:00) gcworker stdout | 2022-11-28 09:44:17,089 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:44:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:32 UTC)" (scheduled at 2022-11-28 09:44:22.901291+00:00) notificationworker stdout | 2022-11-28 09:44:22,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:44:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:53 UTC)" (scheduled at 2022-11-28 09:44:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:44:23,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:44:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:44:24,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:44:24,496 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:44:24,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:24,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:24,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:44:24,511 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 09:44:24,590 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.129 118 0.129) gunicorn-web stdout | 2022-11-28 09:44:24,600 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:44:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:42 UTC)" (scheduled at 2022-11-28 09:44:32.901291+00:00) notificationworker stdout | 2022-11-28 09:44:33,021 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:44:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:33 UTC)" (scheduled at 2022-11-28 09:44:33.026570+00:00) notificationworker stdout | 2022-11-28 09:44:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:44:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:33 UTC)" (scheduled at 2022-11-28 09:44:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:44:33,429 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:44:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:07 UTC)" (scheduled at 2022-11-28 09:44:37.716126+00:00) securityworker stdout | 2022-11-28 09:44:37,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:44:37,767 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:44:37,768 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:44:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:49:38 UTC)" (scheduled at 2022-11-28 09:44:38.024004+00:00) notificationworker stdout | 2022-11-28 09:44:38,078 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:49:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:44:39,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:44:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:44:39,497 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:39,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:39,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:44:39,499 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) gunicorn-web stdout | 2022-11-28 09:44:39,540 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 09:44:39,554 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:44:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:52 UTC)" (scheduled at 2022-11-28 09:44:42.901291+00:00) notificationworker stdout | 2022-11-28 09:44:42,969 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:44:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:44:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:15 UTC)" (scheduled at 2022-11-28 09:44:45.911636+00:00) securityworker stdout | 2022-11-28 09:44:46,006 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:44:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:17 UTC)" (scheduled at 2022-11-28 09:44:47.016425+00:00) gcworker stdout | 2022-11-28 09:44:47,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:44:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:50 UTC)" (scheduled at 2022-11-28 09:44:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:44:50,171 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:44:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:51 UTC)" (scheduled at 2022-11-28 09:44:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:44:51,795 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:44:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:02 UTC)" (scheduled at 2022-11-28 09:44:52.901291+00:00) notificationworker stdout | 2022-11-28 09:44:52,959 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:44:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:23 UTC)" (scheduled at 2022-11-28 09:44:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:44:53,178 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:44:54,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:44:54,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 09:44:54,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:44:54,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:44:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:44:54,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 09:44:54,592 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:44:54,603 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:44:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:44:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) securityscanningnotificationworker stdout | 2022-11-28 09:44:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:56 UTC)" (scheduled at 2022-11-28 09:44:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:44:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:44:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:57 UTC)" (scheduled at 2022-11-28 09:44:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:44:57,596 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:45:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:45:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:12 UTC)" (scheduled at 2022-11-28 09:45:02.901291+00:00) notificationworker stdout | 2022-11-28 09:45:02,958 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:45:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:03 UTC)" (scheduled at 2022-11-28 09:45:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:45:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:45:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:06 UTC)" (scheduled at 2022-11-28 09:45:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:45:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:45:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:37 UTC)" (scheduled at 2022-11-28 09:45:07.716126+00:00) securityworker stdout | 2022-11-28 09:45:07,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:45:07,810 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:45:07,811 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:45:09,492 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:45:09,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:45:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:45:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:45:09,557 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) gunicorn-web stdout | 2022-11-28 09:45:09,581 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:45:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:22 UTC)" (scheduled at 2022-11-28 09:45:12.901291+00:00) notificationworker stdout | 2022-11-28 09:45:12,995 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:45:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:15 UTC)" (scheduled at 2022-11-28 09:45:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:45:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:45:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:45 UTC)" (scheduled at 2022-11-28 09:45:15.911636+00:00) securityworker stdout | 2022-11-28 09:45:16,150 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:45:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:47 UTC)" (scheduled at 2022-11-28 09:45:17.016425+00:00) gcworker stdout | 2022-11-28 09:45:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:45:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:32 UTC)" (scheduled at 2022-11-28 09:45:22.901291+00:00) notificationworker stdout | 2022-11-28 09:45:23,067 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:45:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:53 UTC)" (scheduled at 2022-11-28 09:45:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:45:23,188 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:45:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:45:24,483 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:45:24,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:45:24,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:24,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:45:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:24,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:45:24,769 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.297 118 0.297) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.299 118 0.299) gunicorn-web stdout | 2022-11-28 09:45:24,772 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:45:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:42 UTC)" (scheduled at 2022-11-28 09:45:32.901291+00:00) notificationworker stdout | 2022-11-28 09:45:32,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:45:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:33 UTC)" (scheduled at 2022-11-28 09:45:33.026570+00:00) notificationworker stdout | 2022-11-28 09:45:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:45:33,325 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:33 UTC)" (scheduled at 2022-11-28 09:45:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:45:33,413 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:45:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:07 UTC)" (scheduled at 2022-11-28 09:45:37.716126+00:00) securityworker stdout | 2022-11-28 09:45:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:45:37,888 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:45:37,888 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:45:39,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:45:39,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:45:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:39,497 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:45:39,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:39,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 09:45:39,607 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.133) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.146 118 0.146) gunicorn-web stdout | 2022-11-28 09:45:39,620 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:45:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:50:41 UTC)" (scheduled at 2022-11-28 09:45:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:45:41,243 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:50:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:45:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:52 UTC)" (scheduled at 2022-11-28 09:45:42.901291+00:00) notificationworker stdout | 2022-11-28 09:45:42,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:45:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:45:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:15 UTC)" (scheduled at 2022-11-28 09:45:45.911636+00:00) securityworker stdout | 2022-11-28 09:45:46,045 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:45:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:17 UTC)" (scheduled at 2022-11-28 09:45:47.016425+00:00) gcworker stdout | 2022-11-28 09:45:47,140 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:45:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:50:48 UTC)" (scheduled at 2022-11-28 09:45:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:45:48,212 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:50:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:45:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:50 UTC)" (scheduled at 2022-11-28 09:45:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:45:50,227 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:45:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:51 UTC)" (scheduled at 2022-11-28 09:45:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:45:51,796 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:45:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:02 UTC)" (scheduled at 2022-11-28 09:45:52.901291+00:00) notificationworker stdout | 2022-11-28 09:45:52,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:45:53,117 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:23 UTC)" (scheduled at 2022-11-28 09:45:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:45:53,192 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:45:54,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:45:54,495 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:45:54,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:54,508 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 09:45:54,512 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:45:54,516 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.173 118 0.173) gunicorn-web stdout | 2022-11-28 09:45:54,649 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:45:54,650 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:45:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:45:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.176 118 0.176) securityscanningnotificationworker stdout | 2022-11-28 09:45:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:56 UTC)" (scheduled at 2022-11-28 09:45:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:45:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:45:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:57 UTC)" (scheduled at 2022-11-28 09:45:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:45:57,726 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:46:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:46:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:12 UTC)" (scheduled at 2022-11-28 09:46:02.901291+00:00) notificationworker stdout | 2022-11-28 09:46:02,979 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:46:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:03 UTC)" (scheduled at 2022-11-28 09:46:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:46:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:46:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:06 UTC)" (scheduled at 2022-11-28 09:46:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:46:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:46:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:37 UTC)" (scheduled at 2022-11-28 09:46:07.716126+00:00) securityworker stdout | 2022-11-28 09:46:07,762 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:46:07,833 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:46:07,834 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:46:09,484 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:46:09,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:46:09,494 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:09,495 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:46:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:09,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.240 118 0.241) gunicorn-web stdout | 2022-11-28 09:46:09,718 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.260 118 0.260) gunicorn-web stdout | 2022-11-28 09:46:09,733 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:46:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:22 UTC)" (scheduled at 2022-11-28 09:46:12.901291+00:00) notificationworker stdout | 2022-11-28 09:46:12,968 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:46:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:15 UTC)" (scheduled at 2022-11-28 09:46:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:46:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:46:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:45 UTC)" (scheduled at 2022-11-28 09:46:15.911636+00:00) securityworker stdout | 2022-11-28 09:46:15,996 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:46:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:47 UTC)" (scheduled at 2022-11-28 09:46:17.016425+00:00) gcworker stdout | 2022-11-28 09:46:17,181 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:46:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:32 UTC)" (scheduled at 2022-11-28 09:46:22.901291+00:00) notificationworker stdout | 2022-11-28 09:46:22,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:46:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:53 UTC)" (scheduled at 2022-11-28 09:46:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:46:23,187 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:46:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:46:24,487 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:46:24,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:46:24,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:46:24,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:46:24,634 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.166 118 0.166) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.192 118 0.192) gunicorn-web stdout | 2022-11-28 09:46:24,666 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:46:32,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:42 UTC)" (scheduled at 2022-11-28 09:46:32.901291+00:00) notificationworker stdout | 2022-11-28 09:46:32,976 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:46:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:33 UTC)" (scheduled at 2022-11-28 09:46:33.026570+00:00) notificationworker stdout | 2022-11-28 09:46:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:46:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:33 UTC)" (scheduled at 2022-11-28 09:46:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:46:33,380 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:46:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:07 UTC)" (scheduled at 2022-11-28 09:46:37.716126+00:00) securityworker stdout | 2022-11-28 09:46:37,769 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:46:37,903 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:46:37,904 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.001) gunicorn-registry stdout | 2022-11-28 09:46:39,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 09:46:39,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 09:46:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:39,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 09:46:39,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:46:39,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:46:39,628 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.153 118 0.153) gunicorn-web stdout | 2022-11-28 09:46:39,672 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.202 118 0.202) notificationworker stdout | 2022-11-28 09:46:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:52 UTC)" (scheduled at 2022-11-28 09:46:42.901291+00:00) notificationworker stdout | 2022-11-28 09:46:42,978 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:46:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:46:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:15 UTC)" (scheduled at 2022-11-28 09:46:45.911636+00:00) securityworker stdout | 2022-11-28 09:46:46,050 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:46:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:17 UTC)" (scheduled at 2022-11-28 09:46:47.016425+00:00) gcworker stdout | 2022-11-28 09:46:47,080 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:46:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:50 UTC)" (scheduled at 2022-11-28 09:46:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:46:50,240 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:46:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:51 UTC)" (scheduled at 2022-11-28 09:46:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:46:51,812 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:46:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:02 UTC)" (scheduled at 2022-11-28 09:46:52.901291+00:00) notificationworker stdout | 2022-11-28 09:46:53,010 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:46:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:23 UTC)" (scheduled at 2022-11-28 09:46:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:46:53,210 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:46:54,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:46:54,498 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:46:54,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 09:46:54,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:46:54,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:46:54,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 09:46:54,618 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:46:54,674 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:46:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:46:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.201 118 0.201) securityscanningnotificationworker stdout | 2022-11-28 09:46:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:56 UTC)" (scheduled at 2022-11-28 09:46:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:46:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:46:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:57 UTC)" (scheduled at 2022-11-28 09:46:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:46:57,677 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:47:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:47:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:12 UTC)" (scheduled at 2022-11-28 09:47:02.901291+00:00) notificationworker stdout | 2022-11-28 09:47:02,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:47:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:03 UTC)" (scheduled at 2022-11-28 09:47:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:47:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:47:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:06 UTC)" (scheduled at 2022-11-28 09:47:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:47:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:47:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:37 UTC)" (scheduled at 2022-11-28 09:47:07.716126+00:00) securityworker stdout | 2022-11-28 09:47:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:47:07,763 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:47:07,764 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 09:47:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:47:09,497 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:47:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:47:09,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:47:09,528 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 09:47:09,536 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:47:09,606 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.134 118 0.134) gunicorn-web stdout | 2022-11-28 09:47:09,653 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.179 118 0.179) notificationworker stdout | 2022-11-28 09:47:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:22 UTC)" (scheduled at 2022-11-28 09:47:12.901291+00:00) notificationworker stdout | 2022-11-28 09:47:12,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:47:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:15 UTC)" (scheduled at 2022-11-28 09:47:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:47:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:47:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:45 UTC)" (scheduled at 2022-11-28 09:47:15.911636+00:00) securityworker stdout | 2022-11-28 09:47:15,975 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:47:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:47 UTC)" (scheduled at 2022-11-28 09:47:17.016425+00:00) gcworker stdout | 2022-11-28 09:47:17,076 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:47:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:32 UTC)" (scheduled at 2022-11-28 09:47:22.901291+00:00) notificationworker stdout | 2022-11-28 09:47:22,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:47:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:53 UTC)" (scheduled at 2022-11-28 09:47:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:47:23,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:47:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:47:24,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:47:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:47:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:47:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:47:24,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:47:24,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) gunicorn-web stdout | 2022-11-28 09:47:24,571 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:47:24,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.102 118 0.102) notificationworker stdout | 2022-11-28 09:47:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:42 UTC)" (scheduled at 2022-11-28 09:47:32.901291+00:00) notificationworker stdout | 2022-11-28 09:47:32,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:47:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:33 UTC)" (scheduled at 2022-11-28 09:47:33.026570+00:00) notificationworker stdout | 2022-11-28 09:47:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:47:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:33 UTC)" (scheduled at 2022-11-28 09:47:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:47:33,373 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:47:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:07 UTC)" (scheduled at 2022-11-28 09:47:37.716126+00:00) securityworker stdout | 2022-11-28 09:47:37,730 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:47:37,881 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:47:37,882 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:47:39,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:47:39,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:47:39,492 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:47:39,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:47:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:47:39,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:47:39,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) gunicorn-web stdout | 2022-11-28 09:47:39,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:47:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:52 UTC)" (scheduled at 2022-11-28 09:47:42.901291+00:00) notificationworker stdout | 2022-11-28 09:47:42,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:47:52 UTC)" executed successfully servicekey stdout | 2022-11-28 09:47:44,409 [95] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 10:42:44 UTC)" (scheduled at 2022-11-28 09:47:44.408575+00:00) servicekey stdout | 2022-11-28 09:47:44,473 [95] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-11-28 10:42:44 UTC)" executed successfully securityworker stdout | 2022-11-28 09:47:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:15 UTC)" (scheduled at 2022-11-28 09:47:45.911636+00:00) securityworker stdout | 2022-11-28 09:47:45,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:47:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:17 UTC)" (scheduled at 2022-11-28 09:47:47.016425+00:00) gcworker stdout | 2022-11-28 09:47:47,093 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:47:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:50 UTC)" (scheduled at 2022-11-28 09:47:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:47:50,206 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:47:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:51 UTC)" (scheduled at 2022-11-28 09:47:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:47:51,841 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:47:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:02 UTC)" (scheduled at 2022-11-28 09:47:52.901291+00:00) notificationworker stdout | 2022-11-28 09:47:52,997 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:47:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:23 UTC)" (scheduled at 2022-11-28 09:47:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:47:53,206 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:47:54,483 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 09:47:54,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:47:54,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 09:47:54,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:47:54,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:47:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:47:54,734 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.261 118 0.264) gunicorn-web stdout | 2022-11-28 09:47:54,755 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:47:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:47:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.287 118 0.289) securityscanningnotificationworker stdout | 2022-11-28 09:47:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:56 UTC)" (scheduled at 2022-11-28 09:47:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:47:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:47:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:57 UTC)" (scheduled at 2022-11-28 09:47:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:47:57,572 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:48:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:48:02,909 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:12 UTC)" (scheduled at 2022-11-28 09:48:02.901291+00:00) notificationworker stdout | 2022-11-28 09:48:03,004 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:48:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:03 UTC)" (scheduled at 2022-11-28 09:48:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:48:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:48:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:06 UTC)" (scheduled at 2022-11-28 09:48:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:48:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:48:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:37 UTC)" (scheduled at 2022-11-28 09:48:07.716126+00:00) securityworker stdout | 2022-11-28 09:48:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:48:07,878 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:48:07,879 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:48:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 09:48:09,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:48:09,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:48:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:09,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:48:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:48:09,565 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 09:48:09,582 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) notificationworker stdout | 2022-11-28 09:48:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:22 UTC)" (scheduled at 2022-11-28 09:48:12.901291+00:00) notificationworker stdout | 2022-11-28 09:48:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:48:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:15 UTC)" (scheduled at 2022-11-28 09:48:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:48:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:48:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:45 UTC)" (scheduled at 2022-11-28 09:48:15.911636+00:00) securityworker stdout | 2022-11-28 09:48:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:48:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:47 UTC)" (scheduled at 2022-11-28 09:48:17.016425+00:00) gcworker stdout | 2022-11-28 09:48:17,128 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:48:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:32 UTC)" (scheduled at 2022-11-28 09:48:22.901291+00:00) notificationworker stdout | 2022-11-28 09:48:22,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:48:23,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:53 UTC)" (scheduled at 2022-11-28 09:48:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:48:23,162 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:48:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:48:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:48:24,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:48:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:24,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:48:24,508 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:24,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:48:24,582 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.111) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 09:48:24,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:48:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:42 UTC)" (scheduled at 2022-11-28 09:48:32.901291+00:00) notificationworker stdout | 2022-11-28 09:48:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:48:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:33 UTC)" (scheduled at 2022-11-28 09:48:33.026570+00:00) notificationworker stdout | 2022-11-28 09:48:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:48:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:33 UTC)" (scheduled at 2022-11-28 09:48:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:48:33,371 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:48:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:07 UTC)" (scheduled at 2022-11-28 09:48:37.716126+00:00) securityworker stdout | 2022-11-28 09:48:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:48:37,789 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:48:37,789 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:48:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:53:38 UTC)" (scheduled at 2022-11-28 09:48:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:48:38,484 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:53:38 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:48:39,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.002) gunicorn-registry stdout | 2022-11-28 09:48:39,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:39,496 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:48:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.004) gunicorn-web stdout | 2022-11-28 09:48:39,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 09:48:39,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 09:48:39,558 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:48:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:52 UTC)" (scheduled at 2022-11-28 09:48:42.901291+00:00) notificationworker stdout | 2022-11-28 09:48:42,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:48:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:48:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:15 UTC)" (scheduled at 2022-11-28 09:48:45.911636+00:00) securityworker stdout | 2022-11-28 09:48:45,962 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:48:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:17 UTC)" (scheduled at 2022-11-28 09:48:47.016425+00:00) gcworker stdout | 2022-11-28 09:48:47,050 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:48:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:53:49 UTC)" (scheduled at 2022-11-28 09:48:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:48:49,448 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:53:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:48:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:50 UTC)" (scheduled at 2022-11-28 09:48:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:48:50,161 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:48:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:51 UTC)" (scheduled at 2022-11-28 09:48:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:48:51,765 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:48:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:02 UTC)" (scheduled at 2022-11-28 09:48:52.901291+00:00) notificationworker stdout | 2022-11-28 09:48:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:48:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:23 UTC)" (scheduled at 2022-11-28 09:48:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:48:53,163 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:48:54,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:48:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:48:54,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:48:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:48:54,506 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.155 118 0.155) gunicorn-web stdout | 2022-11-28 09:48:54,627 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:48:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.166 118 0.166) gunicorn-web stdout | 2022-11-28 09:48:54,638 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:48:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:48:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:56 UTC)" (scheduled at 2022-11-28 09:48:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:48:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:48:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:57 UTC)" (scheduled at 2022-11-28 09:48:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:48:57,545 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:49:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:49:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:12 UTC)" (scheduled at 2022-11-28 09:49:02.901291+00:00) notificationworker stdout | 2022-11-28 09:49:02,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:49:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:03 UTC)" (scheduled at 2022-11-28 09:49:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:49:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:49:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:06 UTC)" (scheduled at 2022-11-28 09:49:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:49:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:49:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:37 UTC)" (scheduled at 2022-11-28 09:49:07.716126+00:00) securityworker stdout | 2022-11-28 09:49:07,741 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:49:07,807 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:49:07,807 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:49:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:49:09,486 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:49:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:09,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:09,532 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:49:09,532 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) notificationworker stdout | 2022-11-28 09:49:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:22 UTC)" (scheduled at 2022-11-28 09:49:12.901291+00:00) notificationworker stdout | 2022-11-28 09:49:12,956 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:49:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:15 UTC)" (scheduled at 2022-11-28 09:49:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:49:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:49:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:45 UTC)" (scheduled at 2022-11-28 09:49:15.911636+00:00) securityworker stdout | 2022-11-28 09:49:15,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:49:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:47 UTC)" (scheduled at 2022-11-28 09:49:17.016425+00:00) gcworker stdout | 2022-11-28 09:49:17,072 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:49:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:32 UTC)" (scheduled at 2022-11-28 09:49:22.901291+00:00) notificationworker stdout | 2022-11-28 09:49:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:49:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:53 UTC)" (scheduled at 2022-11-28 09:49:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:49:23,140 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:49:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.003) gunicorn-registry stdout | 2022-11-28 09:49:24,484 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 09:49:24,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:49:24,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:49:24,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:24,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.131 118 0.131) gunicorn-web stdout | 2022-11-28 09:49:24,603 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:49:24,604 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.132 118 0.132) notificationworker stdout | 2022-11-28 09:49:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:42 UTC)" (scheduled at 2022-11-28 09:49:32.901291+00:00) notificationworker stdout | 2022-11-28 09:49:32,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:49:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:33 UTC)" (scheduled at 2022-11-28 09:49:33.026570+00:00) notificationworker stdout | 2022-11-28 09:49:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:49:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:33 UTC)" (scheduled at 2022-11-28 09:49:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:49:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:49:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:07 UTC)" (scheduled at 2022-11-28 09:49:37.716126+00:00) securityworker stdout | 2022-11-28 09:49:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:49:37,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:49:37,766 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:49:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:54:38 UTC)" (scheduled at 2022-11-28 09:49:38.024004+00:00) notificationworker stdout | 2022-11-28 09:49:38,079 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:54:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:49:39,488 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:49:39,493 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:49:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:39,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:49:39,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:39,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:39,545 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:49:39,545 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) notificationworker stdout | 2022-11-28 09:49:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:52 UTC)" (scheduled at 2022-11-28 09:49:42.901291+00:00) notificationworker stdout | 2022-11-28 09:49:42,955 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:49:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:49:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:15 UTC)" (scheduled at 2022-11-28 09:49:45.911636+00:00) securityworker stdout | 2022-11-28 09:49:45,979 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:49:47,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:17 UTC)" (scheduled at 2022-11-28 09:49:47.016425+00:00) gcworker stdout | 2022-11-28 09:49:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:49:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:50 UTC)" (scheduled at 2022-11-28 09:49:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:49:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:49:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:51 UTC)" (scheduled at 2022-11-28 09:49:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:49:51,769 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:49:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:02 UTC)" (scheduled at 2022-11-28 09:49:52.901291+00:00) notificationworker stdout | 2022-11-28 09:49:52,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:49:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:23 UTC)" (scheduled at 2022-11-28 09:49:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:49:53,164 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:49:54,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:49:54,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:49:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:54,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:49:54,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:54,499 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:49:54,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:49:54,572 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:49:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:49:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) securityscanningnotificationworker stdout | 2022-11-28 09:49:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:56 UTC)" (scheduled at 2022-11-28 09:49:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:49:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:49:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:57 UTC)" (scheduled at 2022-11-28 09:49:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:49:57,584 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:50:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:50:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:12 UTC)" (scheduled at 2022-11-28 09:50:02.901291+00:00) notificationworker stdout | 2022-11-28 09:50:02,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:50:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:03 UTC)" (scheduled at 2022-11-28 09:50:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:50:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:50:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:06 UTC)" (scheduled at 2022-11-28 09:50:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:50:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:50:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:37 UTC)" (scheduled at 2022-11-28 09:50:07.716126+00:00) securityworker stdout | 2022-11-28 09:50:07,763 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:50:07,827 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:50:07,827 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:50:09,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:50:09,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:50:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:09,506 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:50:09,507 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:50:09,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:50:09,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) notificationworker stdout | 2022-11-28 09:50:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:22 UTC)" (scheduled at 2022-11-28 09:50:12.901291+00:00) notificationworker stdout | 2022-11-28 09:50:12,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:50:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:15 UTC)" (scheduled at 2022-11-28 09:50:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:50:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:50:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:45 UTC)" (scheduled at 2022-11-28 09:50:15.911636+00:00) securityworker stdout | 2022-11-28 09:50:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:50:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:47 UTC)" (scheduled at 2022-11-28 09:50:17.016425+00:00) gcworker stdout | 2022-11-28 09:50:17,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:50:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:32 UTC)" (scheduled at 2022-11-28 09:50:22.901291+00:00) notificationworker stdout | 2022-11-28 09:50:22,985 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:50:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:53 UTC)" (scheduled at 2022-11-28 09:50:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:50:23,186 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:50:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:50:24,492 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:50:24,491 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:24,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.007) gunicorn-web stdout | 2022-11-28 09:50:24,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:50:24,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:50:24,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 09:50:24,556 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:50:24,575 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) notificationworker stdout | 2022-11-28 09:50:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:42 UTC)" (scheduled at 2022-11-28 09:50:32.901291+00:00) notificationworker stdout | 2022-11-28 09:50:32,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:50:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:33 UTC)" (scheduled at 2022-11-28 09:50:33.026570+00:00) notificationworker stdout | 2022-11-28 09:50:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:50:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:33 UTC)" (scheduled at 2022-11-28 09:50:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:50:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:50:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:07 UTC)" (scheduled at 2022-11-28 09:50:37.716126+00:00) securityworker stdout | 2022-11-28 09:50:37,725 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:50:37,847 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:50:37,848 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:50:39,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:50:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:50:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:39,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:50:39,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:50:39,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 09:50:39,552 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:50:41,167 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:55:41 UTC)" (scheduled at 2022-11-28 09:50:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:50:41,251 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:55:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:50:42,912 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:52 UTC)" (scheduled at 2022-11-28 09:50:42.901291+00:00) notificationworker stdout | 2022-11-28 09:50:42,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:50:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:50:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:15 UTC)" (scheduled at 2022-11-28 09:50:45.911636+00:00) securityworker stdout | 2022-11-28 09:50:45,964 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:50:47,043 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:17 UTC)" (scheduled at 2022-11-28 09:50:47.016425+00:00) gcworker stdout | 2022-11-28 09:50:47,138 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:50:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:55:48 UTC)" (scheduled at 2022-11-28 09:50:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:50:48,076 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:55:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:50:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:50 UTC)" (scheduled at 2022-11-28 09:50:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:50:50,195 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:50:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:51 UTC)" (scheduled at 2022-11-28 09:50:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:50:51,778 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:50:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:02 UTC)" (scheduled at 2022-11-28 09:50:52.901291+00:00) notificationworker stdout | 2022-11-28 09:50:52,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:50:53,114 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:23 UTC)" (scheduled at 2022-11-28 09:50:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:50:53,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) gunicorn-registry stdout | 2022-11-28 09:50:54,489 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:50:54,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.002) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:50:54,500 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:50:54,503 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:50:54,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:50:54,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:50:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 09:50:54,553 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:50:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:50:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:56 UTC)" (scheduled at 2022-11-28 09:50:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:50:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:50:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:57 UTC)" (scheduled at 2022-11-28 09:50:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:50:57,568 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:51:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:51:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:12 UTC)" (scheduled at 2022-11-28 09:51:02.901291+00:00) notificationworker stdout | 2022-11-28 09:51:02,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:51:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:03 UTC)" (scheduled at 2022-11-28 09:51:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:51:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:51:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:06 UTC)" (scheduled at 2022-11-28 09:51:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:51:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:51:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:37 UTC)" (scheduled at 2022-11-28 09:51:07.716126+00:00) securityworker stdout | 2022-11-28 09:51:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:51:07,762 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:51:07,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:51:09,483 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:51:09,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:51:09,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:51:09,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:09,504 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:51:09,559 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:51:09,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) notificationworker stdout | 2022-11-28 09:51:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:22 UTC)" (scheduled at 2022-11-28 09:51:12.901291+00:00) notificationworker stdout | 2022-11-28 09:51:12,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:51:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:15 UTC)" (scheduled at 2022-11-28 09:51:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:51:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:51:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:45 UTC)" (scheduled at 2022-11-28 09:51:15.911636+00:00) securityworker stdout | 2022-11-28 09:51:15,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:51:17,019 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:47 UTC)" (scheduled at 2022-11-28 09:51:17.016425+00:00) gcworker stdout | 2022-11-28 09:51:17,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:51:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:32 UTC)" (scheduled at 2022-11-28 09:51:22.901291+00:00) notificationworker stdout | 2022-11-28 09:51:22,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:51:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:53 UTC)" (scheduled at 2022-11-28 09:51:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:51:23,145 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:51:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:51:24,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:51:24,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:51:24,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:24,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.005) gunicorn-web stdout | 2022-11-28 09:51:24,495 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 09:51:24,572 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 09:51:24,589 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:51:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:42 UTC)" (scheduled at 2022-11-28 09:51:32.901291+00:00) notificationworker stdout | 2022-11-28 09:51:32,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:51:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:33 UTC)" (scheduled at 2022-11-28 09:51:33.026570+00:00) notificationworker stdout | 2022-11-28 09:51:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:51:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:33 UTC)" (scheduled at 2022-11-28 09:51:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:51:33,359 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:51:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:07 UTC)" (scheduled at 2022-11-28 09:51:37.716126+00:00) securityworker stdout | 2022-11-28 09:51:37,745 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:51:37,815 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:51:37,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:07 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:51:39,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:51:39,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:51:39,502 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:39,504 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:51:39,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:51:39,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:51:39,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:51:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:52 UTC)" (scheduled at 2022-11-28 09:51:42.901291+00:00) notificationworker stdout | 2022-11-28 09:51:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:51:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:51:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:15 UTC)" (scheduled at 2022-11-28 09:51:45.911636+00:00) securityworker stdout | 2022-11-28 09:51:45,982 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:51:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:17 UTC)" (scheduled at 2022-11-28 09:51:47.016425+00:00) gcworker stdout | 2022-11-28 09:51:47,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:51:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:50 UTC)" (scheduled at 2022-11-28 09:51:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:51:50,162 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:51:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:51 UTC)" (scheduled at 2022-11-28 09:51:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:51:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:51:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:02 UTC)" (scheduled at 2022-11-28 09:51:52.901291+00:00) notificationworker stdout | 2022-11-28 09:51:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:51:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:23 UTC)" (scheduled at 2022-11-28 09:51:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:51:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:51:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:51:54,487 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:51:54,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:54,501 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 09:51:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:51:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:51:54,537 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 09:51:54,543 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:51:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:51:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) securityscanningnotificationworker stdout | 2022-11-28 09:51:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:56 UTC)" (scheduled at 2022-11-28 09:51:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:51:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:51:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:57 UTC)" (scheduled at 2022-11-28 09:51:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:51:57,568 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:52:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:52:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:12 UTC)" (scheduled at 2022-11-28 09:52:02.901291+00:00) notificationworker stdout | 2022-11-28 09:52:02,976 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:52:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:03 UTC)" (scheduled at 2022-11-28 09:52:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:52:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:52:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:06 UTC)" (scheduled at 2022-11-28 09:52:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:52:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:52:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:37 UTC)" (scheduled at 2022-11-28 09:52:07.716126+00:00) securityworker stdout | 2022-11-28 09:52:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:52:07,764 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:52:07,765 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 09:52:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:52:09,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.001) gunicorn-web stdout | 2022-11-28 09:52:09,505 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.000) gunicorn-web stdout | 2022-11-28 09:52:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:52:09,514 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 09:52:09,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:52:09,607 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.132 118 0.133) gunicorn-web stdout | 2022-11-28 09:52:09,613 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.138 118 0.139) notificationworker stdout | 2022-11-28 09:52:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:22 UTC)" (scheduled at 2022-11-28 09:52:12.901291+00:00) notificationworker stdout | 2022-11-28 09:52:12,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:52:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:15 UTC)" (scheduled at 2022-11-28 09:52:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:52:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:52:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:45 UTC)" (scheduled at 2022-11-28 09:52:15.911636+00:00) securityworker stdout | 2022-11-28 09:52:15,945 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:52:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:47 UTC)" (scheduled at 2022-11-28 09:52:17.016425+00:00) gcworker stdout | 2022-11-28 09:52:17,069 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:52:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:32 UTC)" (scheduled at 2022-11-28 09:52:22.901291+00:00) notificationworker stdout | 2022-11-28 09:52:22,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:52:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:53 UTC)" (scheduled at 2022-11-28 09:52:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:52:23,154 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:52:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:52:24,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.003) gunicorn-registry stdout | 2022-11-28 09:52:24,483 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:52:24,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:24,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:52:24,494 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:52:24,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.057 118 0.057) gunicorn-web stdout | 2022-11-28 09:52:24,529 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:52:24,531 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) notificationworker stdout | 2022-11-28 09:52:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:42 UTC)" (scheduled at 2022-11-28 09:52:32.901291+00:00) notificationworker stdout | 2022-11-28 09:52:32,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:52:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:33 UTC)" (scheduled at 2022-11-28 09:52:33.026570+00:00) notificationworker stdout | 2022-11-28 09:52:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:52:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:33 UTC)" (scheduled at 2022-11-28 09:52:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:52:33,402 [90] [INFO] [redis_lock.acquire] Got lock for 'lock:LARGE_GARBAGE_COLLECTION'. repositorygcworker stdout | 2022-11-28 09:52:34,848 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:52:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:07 UTC)" (scheduled at 2022-11-28 09:52:37.716126+00:00) securityworker stdout | 2022-11-28 09:52:37,737 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:52:37,880 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:52:37,881 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:52:39,486 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 162 0.003) gunicorn-registry stdout | 2022-11-28 09:52:39,491 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:39,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:39,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:52:39,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:52:39,576 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.102) gunicorn-web stdout | 2022-11-28 09:52:39,577 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.105) notificationworker stdout | 2022-11-28 09:52:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:52 UTC)" (scheduled at 2022-11-28 09:52:42.901291+00:00) notificationworker stdout | 2022-11-28 09:52:42,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:52:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:52:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:15 UTC)" (scheduled at 2022-11-28 09:52:45.911636+00:00) securityworker stdout | 2022-11-28 09:52:45,987 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:52:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:17 UTC)" (scheduled at 2022-11-28 09:52:47.016425+00:00) gcworker stdout | 2022-11-28 09:52:47,086 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:52:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:50 UTC)" (scheduled at 2022-11-28 09:52:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:52:50,166 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:52:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:51 UTC)" (scheduled at 2022-11-28 09:52:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:52:51,805 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:52:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:02 UTC)" (scheduled at 2022-11-28 09:52:52.901291+00:00) notificationworker stdout | 2022-11-28 09:52:52,980 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:52:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:23 UTC)" (scheduled at 2022-11-28 09:52:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:52:53,177 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:52:54,484 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:52:54,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:54,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:52:54,496 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:52:54,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:52:54,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.115 118 0.115) gunicorn-web stdout | 2022-11-28 09:52:54,588 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:52:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 09:52:54,591 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:52:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:52:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:56 UTC)" (scheduled at 2022-11-28 09:52:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:52:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:52:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:57 UTC)" (scheduled at 2022-11-28 09:52:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:52:57,616 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:53:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:53:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:12 UTC)" (scheduled at 2022-11-28 09:53:02.901291+00:00) notificationworker stdout | 2022-11-28 09:53:02,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:53:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:03 UTC)" (scheduled at 2022-11-28 09:53:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:53:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:53:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:06 UTC)" (scheduled at 2022-11-28 09:53:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:53:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:53:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:37 UTC)" (scheduled at 2022-11-28 09:53:07.716126+00:00) securityworker stdout | 2022-11-28 09:53:07,779 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:53:07,932 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:53:07,933 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:53:09,484 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:53:09,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-web stdout | 2022-11-28 09:53:09,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:53:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:53:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:53:09,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 09:53:09,537 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:53:09,542 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 09:53:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:22 UTC)" (scheduled at 2022-11-28 09:53:12.901291+00:00) notificationworker stdout | 2022-11-28 09:53:12,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:53:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:15 UTC)" (scheduled at 2022-11-28 09:53:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:53:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:53:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:45 UTC)" (scheduled at 2022-11-28 09:53:15.911636+00:00) securityworker stdout | 2022-11-28 09:53:15,976 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:53:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:47 UTC)" (scheduled at 2022-11-28 09:53:17.016425+00:00) gcworker stdout | 2022-11-28 09:53:17,068 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:53:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:32 UTC)" (scheduled at 2022-11-28 09:53:22.901291+00:00) notificationworker stdout | 2022-11-28 09:53:22,952 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:53:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:53 UTC)" (scheduled at 2022-11-28 09:53:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:53:23,156 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:53:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:53:24,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:53:24,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:53:24,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:53:24,502 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:53:24,503 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:53:24,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.118 118 0.118) gunicorn-web stdout | 2022-11-28 09:53:24,591 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:53:24,594 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) notificationworker stdout | 2022-11-28 09:53:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:42 UTC)" (scheduled at 2022-11-28 09:53:32.901291+00:00) notificationworker stdout | 2022-11-28 09:53:32,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:53:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:33 UTC)" (scheduled at 2022-11-28 09:53:33.026570+00:00) notificationworker stdout | 2022-11-28 09:53:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:53:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:33 UTC)" (scheduled at 2022-11-28 09:53:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:53:33,355 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:53:37,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:07 UTC)" (scheduled at 2022-11-28 09:53:37.716126+00:00) securityworker stdout | 2022-11-28 09:53:37,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:53:37,773 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:53:37,773 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:53:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:58:38 UTC)" (scheduled at 2022-11-28 09:53:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:53:38,472 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:58:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:53:39,493 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:53:39,497 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:53:39,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:53:39,513 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:53:39,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:53:39,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) gunicorn-web stdout | 2022-11-28 09:53:39,568 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:53:39,569 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.097) notificationworker stdout | 2022-11-28 09:53:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:52 UTC)" (scheduled at 2022-11-28 09:53:42.901291+00:00) notificationworker stdout | 2022-11-28 09:53:42,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:53:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:53:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:15 UTC)" (scheduled at 2022-11-28 09:53:45.911636+00:00) securityworker stdout | 2022-11-28 09:53:45,953 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:53:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:17 UTC)" (scheduled at 2022-11-28 09:53:47.016425+00:00) gcworker stdout | 2022-11-28 09:53:47,070 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:53:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:58:49 UTC)" (scheduled at 2022-11-28 09:53:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:53:49,471 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:58:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:53:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:50 UTC)" (scheduled at 2022-11-28 09:53:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:53:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:53:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:51 UTC)" (scheduled at 2022-11-28 09:53:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:53:51,786 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:53:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:02 UTC)" (scheduled at 2022-11-28 09:53:52.901291+00:00) notificationworker stdout | 2022-11-28 09:53:52,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:53:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:23 UTC)" (scheduled at 2022-11-28 09:53:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:53:53,163 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:53:54,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:53:54,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:53:54,503 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:53:54,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:53:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:53:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:53:54,574 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 09:53:54,587 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:53:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:53:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) securityscanningnotificationworker stdout | 2022-11-28 09:53:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:56 UTC)" (scheduled at 2022-11-28 09:53:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:53:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:53:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:57 UTC)" (scheduled at 2022-11-28 09:53:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:53:57,575 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:54:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:54:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:12 UTC)" (scheduled at 2022-11-28 09:54:02.901291+00:00) notificationworker stdout | 2022-11-28 09:54:02,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:54:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:03 UTC)" (scheduled at 2022-11-28 09:54:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:54:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:54:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:06 UTC)" (scheduled at 2022-11-28 09:54:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:54:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:54:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:37 UTC)" (scheduled at 2022-11-28 09:54:07.716126+00:00) securityworker stdout | 2022-11-28 09:54:07,749 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:54:07,806 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:54:07,807 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:54:09,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-web stdout | 2022-11-28 09:54:09,493 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:54:09,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 09:54:09,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:54:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:54:09,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:54:09,547 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:54:09,548 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) notificationworker stdout | 2022-11-28 09:54:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:22 UTC)" (scheduled at 2022-11-28 09:54:12.901291+00:00) notificationworker stdout | 2022-11-28 09:54:12,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:54:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:15 UTC)" (scheduled at 2022-11-28 09:54:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:54:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:54:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:45 UTC)" (scheduled at 2022-11-28 09:54:15.911636+00:00) securityworker stdout | 2022-11-28 09:54:15,996 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:54:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:47 UTC)" (scheduled at 2022-11-28 09:54:17.016425+00:00) gcworker stdout | 2022-11-28 09:54:17,073 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:54:22,905 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:32 UTC)" (scheduled at 2022-11-28 09:54:22.901291+00:00) notificationworker stdout | 2022-11-28 09:54:22,971 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:54:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:53 UTC)" (scheduled at 2022-11-28 09:54:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:54:23,270 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:54:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:54:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-registry stdout | 2022-11-28 09:54:24,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:54:24,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:54:24,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:54:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:54:24,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.116 118 0.116) gunicorn-web stdout | 2022-11-28 09:54:24,589 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.127 118 0.127) gunicorn-web stdout | 2022-11-28 09:54:24,601 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:54:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:42 UTC)" (scheduled at 2022-11-28 09:54:32.901291+00:00) notificationworker stdout | 2022-11-28 09:54:32,954 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:54:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:33 UTC)" (scheduled at 2022-11-28 09:54:33.026570+00:00) notificationworker stdout | 2022-11-28 09:54:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:54:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:33 UTC)" (scheduled at 2022-11-28 09:54:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:54:33,411 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:54:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:07 UTC)" (scheduled at 2022-11-28 09:54:37.716126+00:00) securityworker stdout | 2022-11-28 09:54:37,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:54:37,867 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:54:37,868 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:54:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:59:38 UTC)" (scheduled at 2022-11-28 09:54:38.024004+00:00) notificationworker stdout | 2022-11-28 09:54:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 09:59:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:54:39,482 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:54:39,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:54:39,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:54:39,493 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:54:39,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:54:39,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:54:39,556 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) gunicorn-web stdout | 2022-11-28 09:54:39,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:54:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:52 UTC)" (scheduled at 2022-11-28 09:54:42.901291+00:00) notificationworker stdout | 2022-11-28 09:54:42,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:54:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:54:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:15 UTC)" (scheduled at 2022-11-28 09:54:45.911636+00:00) securityworker stdout | 2022-11-28 09:54:46,005 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:54:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:17 UTC)" (scheduled at 2022-11-28 09:54:47.016425+00:00) gcworker stdout | 2022-11-28 09:54:47,098 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:54:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:50 UTC)" (scheduled at 2022-11-28 09:54:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:54:50,193 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:54:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:51 UTC)" (scheduled at 2022-11-28 09:54:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:54:51,788 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:54:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:02 UTC)" (scheduled at 2022-11-28 09:54:52.901291+00:00) notificationworker stdout | 2022-11-28 09:54:52,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:54:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:23 UTC)" (scheduled at 2022-11-28 09:54:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:54:53,191 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:54:54,491 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:54:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-web stdout | 2022-11-28 09:54:54,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:54:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:54:54,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:54:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:54:54,618 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.144 118 0.144) gunicorn-web stdout | 2022-11-28 09:54:54,619 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:54:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:54:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.145 118 0.145) securityscanningnotificationworker stdout | 2022-11-28 09:54:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:56 UTC)" (scheduled at 2022-11-28 09:54:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:54:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:54:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:57 UTC)" (scheduled at 2022-11-28 09:54:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:54:57,621 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:55:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:55:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:12 UTC)" (scheduled at 2022-11-28 09:55:02.901291+00:00) notificationworker stdout | 2022-11-28 09:55:02,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:55:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:03 UTC)" (scheduled at 2022-11-28 09:55:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:55:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:55:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:06 UTC)" (scheduled at 2022-11-28 09:55:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:55:06,425 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:55:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:37 UTC)" (scheduled at 2022-11-28 09:55:07.716126+00:00) securityworker stdout | 2022-11-28 09:55:07,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:55:07,775 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:55:07,777 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:55:09,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:55:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:55:09,504 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:09,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:09,506 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:55:09,507 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.081 118 0.081) gunicorn-web stdout | 2022-11-28 09:55:09,552 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:55:09,553 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:55:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:22 UTC)" (scheduled at 2022-11-28 09:55:12.901291+00:00) notificationworker stdout | 2022-11-28 09:55:12,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:55:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:15 UTC)" (scheduled at 2022-11-28 09:55:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:55:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:55:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:45 UTC)" (scheduled at 2022-11-28 09:55:15.911636+00:00) securityworker stdout | 2022-11-28 09:55:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:55:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:47 UTC)" (scheduled at 2022-11-28 09:55:17.016425+00:00) gcworker stdout | 2022-11-28 09:55:17,062 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:55:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:32 UTC)" (scheduled at 2022-11-28 09:55:22.901291+00:00) notificationworker stdout | 2022-11-28 09:55:22,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:55:23,119 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:53 UTC)" (scheduled at 2022-11-28 09:55:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:55:23,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:55:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:55:24,517 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 09:55:24,534 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:24,544 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:24,548 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:55:24,550 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:55:24,552 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:55:24,601 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:55:24,601 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.109) notificationworker stdout | 2022-11-28 09:55:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:42 UTC)" (scheduled at 2022-11-28 09:55:32.901291+00:00) notificationworker stdout | 2022-11-28 09:55:32,947 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:55:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:33 UTC)" (scheduled at 2022-11-28 09:55:33.026570+00:00) notificationworker stdout | 2022-11-28 09:55:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:55:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:33 UTC)" (scheduled at 2022-11-28 09:55:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:55:33,358 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:55:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:07 UTC)" (scheduled at 2022-11-28 09:55:37.716126+00:00) securityworker stdout | 2022-11-28 09:55:37,720 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:55:37,772 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:55:37,773 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 09:55:39,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:55:39,497 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:55:39,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:39,511 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 09:55:39,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:55:39,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:55:39,570 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:55:39,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) securityscanningnotificationworker stdout | 2022-11-28 09:55:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:00:41 UTC)" (scheduled at 2022-11-28 09:55:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:55:41,197 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:00:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:55:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:52 UTC)" (scheduled at 2022-11-28 09:55:42.901291+00:00) notificationworker stdout | 2022-11-28 09:55:42,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:55:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:55:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:15 UTC)" (scheduled at 2022-11-28 09:55:45.911636+00:00) securityworker stdout | 2022-11-28 09:55:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:55:47,021 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:17 UTC)" (scheduled at 2022-11-28 09:55:47.016425+00:00) gcworker stdout | 2022-11-28 09:55:47,075 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:55:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:00:48 UTC)" (scheduled at 2022-11-28 09:55:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 09:55:48,082 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:00:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:55:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:50 UTC)" (scheduled at 2022-11-28 09:55:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:55:50,170 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:55:51,737 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:51 UTC)" (scheduled at 2022-11-28 09:55:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:55:51,780 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:55:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:02 UTC)" (scheduled at 2022-11-28 09:55:52.901291+00:00) notificationworker stdout | 2022-11-28 09:55:52,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:55:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:23 UTC)" (scheduled at 2022-11-28 09:55:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:55:53,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:55:54,494 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.015 162 0.015) gunicorn-registry stdout | 2022-11-28 09:55:54,505 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:54,508 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:55:54,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:55:54,524 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:55:54,526 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 09:55:54,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:55:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.094 118 0.094) gunicorn-web stdout | 2022-11-28 09:55:54,567 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:55:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:55:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:56 UTC)" (scheduled at 2022-11-28 09:55:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:55:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:55:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:57 UTC)" (scheduled at 2022-11-28 09:55:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:55:57,552 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:56:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:56:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:12 UTC)" (scheduled at 2022-11-28 09:56:02.901291+00:00) notificationworker stdout | 2022-11-28 09:56:02,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:56:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:03 UTC)" (scheduled at 2022-11-28 09:56:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:56:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:56:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:06 UTC)" (scheduled at 2022-11-28 09:56:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:56:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:56:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:37 UTC)" (scheduled at 2022-11-28 09:56:07.716126+00:00) securityworker stdout | 2022-11-28 09:56:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:56:07,758 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:56:07,759 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:56:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:56:09,489 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:56:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:56:09,501 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:56:09,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:56:09,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 09:56:09,538 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) gunicorn-web stdout | 2022-11-28 09:56:09,544 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:56:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:22 UTC)" (scheduled at 2022-11-28 09:56:12.901291+00:00) notificationworker stdout | 2022-11-28 09:56:12,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:56:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:15 UTC)" (scheduled at 2022-11-28 09:56:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:56:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:56:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:45 UTC)" (scheduled at 2022-11-28 09:56:15.911636+00:00) securityworker stdout | 2022-11-28 09:56:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:56:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:47 UTC)" (scheduled at 2022-11-28 09:56:17.016425+00:00) gcworker stdout | 2022-11-28 09:56:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:56:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:32 UTC)" (scheduled at 2022-11-28 09:56:22.901291+00:00) notificationworker stdout | 2022-11-28 09:56:22,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:56:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:53 UTC)" (scheduled at 2022-11-28 09:56:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:56:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:56:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:56:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:56:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:56:24,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:56:24,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:56:24,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:56:24,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.122 118 0.122) gunicorn-web stdout | 2022-11-28 09:56:24,595 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:56:24,600 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.128 118 0.128) notificationworker stdout | 2022-11-28 09:56:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:42 UTC)" (scheduled at 2022-11-28 09:56:32.901291+00:00) notificationworker stdout | 2022-11-28 09:56:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:56:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:33 UTC)" (scheduled at 2022-11-28 09:56:33.026570+00:00) notificationworker stdout | 2022-11-28 09:56:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:56:33,324 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:33 UTC)" (scheduled at 2022-11-28 09:56:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:56:33,380 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:56:37,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:07 UTC)" (scheduled at 2022-11-28 09:56:37.716126+00:00) securityworker stdout | 2022-11-28 09:56:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:56:37,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:56:37,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:56:39,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:56:39,495 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 09:56:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:56:39,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:56:39,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.009) gunicorn-web stdout | 2022-11-28 09:56:39,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:56:39,562 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 09:56:39,576 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:56:42,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:52 UTC)" (scheduled at 2022-11-28 09:56:42.901291+00:00) notificationworker stdout | 2022-11-28 09:56:42,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:56:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:56:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:15 UTC)" (scheduled at 2022-11-28 09:56:45.911636+00:00) securityworker stdout | 2022-11-28 09:56:45,978 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:56:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:17 UTC)" (scheduled at 2022-11-28 09:56:47.016425+00:00) gcworker stdout | 2022-11-28 09:56:47,067 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:56:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:50 UTC)" (scheduled at 2022-11-28 09:56:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:56:50,157 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:56:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:51 UTC)" (scheduled at 2022-11-28 09:56:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:56:51,771 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:56:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:02 UTC)" (scheduled at 2022-11-28 09:56:52.901291+00:00) notificationworker stdout | 2022-11-28 09:56:52,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:56:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:23 UTC)" (scheduled at 2022-11-28 09:56:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:56:53,144 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:56:54,484 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:56:54,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:56:54,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:56:54,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:56:54,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:56:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:56:54,557 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:56:54,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:56:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:56:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) securityscanningnotificationworker stdout | 2022-11-28 09:56:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:56 UTC)" (scheduled at 2022-11-28 09:56:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:56:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:56:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:57 UTC)" (scheduled at 2022-11-28 09:56:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:56:57,582 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:57:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:57:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:12 UTC)" (scheduled at 2022-11-28 09:57:02.901291+00:00) notificationworker stdout | 2022-11-28 09:57:02,970 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:57:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:03 UTC)" (scheduled at 2022-11-28 09:57:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:57:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:57:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:06 UTC)" (scheduled at 2022-11-28 09:57:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:57:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:57:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:37 UTC)" (scheduled at 2022-11-28 09:57:07.716126+00:00) securityworker stdout | 2022-11-28 09:57:07,734 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:57:07,782 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:57:07,783 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:57:09,485 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:57:09,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 09:57:09,496 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:09,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:57:09,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:09,503 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 09:57:09,556 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 09:57:09,558 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:57:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:22 UTC)" (scheduled at 2022-11-28 09:57:12.901291+00:00) notificationworker stdout | 2022-11-28 09:57:12,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:57:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:15 UTC)" (scheduled at 2022-11-28 09:57:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:57:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:57:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:45 UTC)" (scheduled at 2022-11-28 09:57:15.911636+00:00) securityworker stdout | 2022-11-28 09:57:15,958 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:57:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:47 UTC)" (scheduled at 2022-11-28 09:57:17.016425+00:00) gcworker stdout | 2022-11-28 09:57:17,054 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:57:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:32 UTC)" (scheduled at 2022-11-28 09:57:22.901291+00:00) notificationworker stdout | 2022-11-28 09:57:22,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:57:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:53 UTC)" (scheduled at 2022-11-28 09:57:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:57:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:57:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:57:24,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 09:57:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:57:24,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:24,505 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:57:24,509 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:24,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:57:24,581 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.111 118 0.112) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.126 118 0.126) gunicorn-web stdout | 2022-11-28 09:57:24,599 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:57:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:42 UTC)" (scheduled at 2022-11-28 09:57:32.901291+00:00) notificationworker stdout | 2022-11-28 09:57:32,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:57:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:33 UTC)" (scheduled at 2022-11-28 09:57:33.026570+00:00) notificationworker stdout | 2022-11-28 09:57:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:57:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:33 UTC)" (scheduled at 2022-11-28 09:57:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:57:33,419 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:57:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:07 UTC)" (scheduled at 2022-11-28 09:57:37.716126+00:00) securityworker stdout | 2022-11-28 09:57:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:57:37,896 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:57:37,896 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:57:39,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:57:39,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:39,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:39,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:57:39,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:57:39,573 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.100 118 0.100) gunicorn-web stdout | 2022-11-28 09:57:39,583 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.110 118 0.110) notificationworker stdout | 2022-11-28 09:57:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:52 UTC)" (scheduled at 2022-11-28 09:57:42.901291+00:00) notificationworker stdout | 2022-11-28 09:57:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:57:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:57:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:15 UTC)" (scheduled at 2022-11-28 09:57:45.911636+00:00) securityworker stdout | 2022-11-28 09:57:46,011 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:57:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:17 UTC)" (scheduled at 2022-11-28 09:57:47.016425+00:00) gcworker stdout | 2022-11-28 09:57:47,065 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:57:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:50 UTC)" (scheduled at 2022-11-28 09:57:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:57:50,176 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:57:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:51 UTC)" (scheduled at 2022-11-28 09:57:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:57:51,800 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:57:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:02 UTC)" (scheduled at 2022-11-28 09:57:52.901291+00:00) notificationworker stdout | 2022-11-28 09:57:52,961 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:57:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:23 UTC)" (scheduled at 2022-11-28 09:57:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:57:53,160 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:57:54,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.004) gunicorn-registry stdout | 2022-11-28 09:57:54,504 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:57:54,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:57:54,518 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:57:54,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) gunicorn-web stdout | 2022-11-28 09:57:54,578 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:57:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.109 118 0.109) gunicorn-web stdout | 2022-11-28 09:57:54,590 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:57:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 09:57:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:56 UTC)" (scheduled at 2022-11-28 09:57:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:57:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:57:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:57 UTC)" (scheduled at 2022-11-28 09:57:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:57:57,579 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:58:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:58:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:12 UTC)" (scheduled at 2022-11-28 09:58:02.901291+00:00) notificationworker stdout | 2022-11-28 09:58:02,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:58:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:03 UTC)" (scheduled at 2022-11-28 09:58:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:58:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:58:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:06 UTC)" (scheduled at 2022-11-28 09:58:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:58:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:58:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:37 UTC)" (scheduled at 2022-11-28 09:58:07.716126+00:00) securityworker stdout | 2022-11-28 09:58:07,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:58:07,800 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:58:07,801 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:58:09,492 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:09,505 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-registry stdout | 2022-11-28 09:58:09,508 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:09,508 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.020 162 0.020) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:58:09,525 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:09,529 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:58:09,571 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) gunicorn-web stdout | 2022-11-28 09:58:09,577 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.099 118 0.099) notificationworker stdout | 2022-11-28 09:58:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:22 UTC)" (scheduled at 2022-11-28 09:58:12.901291+00:00) notificationworker stdout | 2022-11-28 09:58:12,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:58:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:15 UTC)" (scheduled at 2022-11-28 09:58:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:58:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:58:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:45 UTC)" (scheduled at 2022-11-28 09:58:15.911636+00:00) securityworker stdout | 2022-11-28 09:58:15,941 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:58:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:47 UTC)" (scheduled at 2022-11-28 09:58:17.016425+00:00) gcworker stdout | 2022-11-28 09:58:17,048 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:58:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:32 UTC)" (scheduled at 2022-11-28 09:58:22.901291+00:00) notificationworker stdout | 2022-11-28 09:58:22,946 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:58:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:53 UTC)" (scheduled at 2022-11-28 09:58:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:58:23,155 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:58:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:58:24,495 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:58:24,499 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:58:24,500 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:24,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:58:24,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:24,512 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:58:24,548 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.071 118 0.071) gunicorn-web stdout | 2022-11-28 09:58:24,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:58:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:42 UTC)" (scheduled at 2022-11-28 09:58:32.901291+00:00) notificationworker stdout | 2022-11-28 09:58:32,931 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:58:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:33 UTC)" (scheduled at 2022-11-28 09:58:33.026570+00:00) notificationworker stdout | 2022-11-28 09:58:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:58:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:33 UTC)" (scheduled at 2022-11-28 09:58:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:58:33,353 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:58:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:07 UTC)" (scheduled at 2022-11-28 09:58:37.716126+00:00) securityworker stdout | 2022-11-28 09:58:37,733 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:58:37,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:58:37,782 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:58:38,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:03:38 UTC)" (scheduled at 2022-11-28 09:58:38.420756+00:00) namespacegcworker stdout | 2022-11-28 09:58:38,611 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:03:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:58:39,485 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:58:39,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:58:39,498 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 09:58:39,504 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:39,508 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:58:39,525 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.053 118 0.053) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) gunicorn-web stdout | 2022-11-28 09:58:39,534 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:58:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:52 UTC)" (scheduled at 2022-11-28 09:58:42.901291+00:00) notificationworker stdout | 2022-11-28 09:58:42,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:58:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:58:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:15 UTC)" (scheduled at 2022-11-28 09:58:45.911636+00:00) securityworker stdout | 2022-11-28 09:58:46,005 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:58:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:17 UTC)" (scheduled at 2022-11-28 09:58:47.016425+00:00) gcworker stdout | 2022-11-28 09:58:47,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:58:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:03:49 UTC)" (scheduled at 2022-11-28 09:58:49.405459+00:00) repositorygcworker stdout | 2022-11-28 09:58:49,460 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:03:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:58:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:50 UTC)" (scheduled at 2022-11-28 09:58:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:58:50,159 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:58:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:51 UTC)" (scheduled at 2022-11-28 09:58:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:58:51,762 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:58:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:02 UTC)" (scheduled at 2022-11-28 09:58:52.901291+00:00) notificationworker stdout | 2022-11-28 09:58:52,949 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:58:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:23 UTC)" (scheduled at 2022-11-28 09:58:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:58:53,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 09:58:54,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 09:58:54,498 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:58:54,501 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:58:54,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:58:54,512 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 09:58:54,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:58:54,547 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 09:58:54,579 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:58:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:58:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.108 118 0.108) securityscanningnotificationworker stdout | 2022-11-28 09:58:56,164 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:56 UTC)" (scheduled at 2022-11-28 09:58:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:58:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:58:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:57 UTC)" (scheduled at 2022-11-28 09:58:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:58:57,547 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 09:59:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:59:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:12 UTC)" (scheduled at 2022-11-28 09:59:02.901291+00:00) notificationworker stdout | 2022-11-28 09:59:02,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:59:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:03 UTC)" (scheduled at 2022-11-28 09:59:03.406131+00:00) repositorygcworker stdout | 2022-11-28 09:59:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:59:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:06 UTC)" (scheduled at 2022-11-28 09:59:06.421235+00:00) namespacegcworker stdout | 2022-11-28 09:59:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:06 UTC)" executed successfully securityworker stdout | 2022-11-28 09:59:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:37 UTC)" (scheduled at 2022-11-28 09:59:07.716126+00:00) securityworker stdout | 2022-11-28 09:59:07,728 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:59:07,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:59:07,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:59:09,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 09:59:09,490 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:59:09,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:09,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:59:09,502 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:09,504 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:59:09,567 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) gunicorn-web stdout | 2022-11-28 09:59:09,570 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 09:59:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:22 UTC)" (scheduled at 2022-11-28 09:59:12.901291+00:00) notificationworker stdout | 2022-11-28 09:59:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:59:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:15 UTC)" (scheduled at 2022-11-28 09:59:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 09:59:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:15 UTC)" executed successfully securityworker stdout | 2022-11-28 09:59:15,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:45 UTC)" (scheduled at 2022-11-28 09:59:15.911636+00:00) securityworker stdout | 2022-11-28 09:59:15,956 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:45 UTC)" executed successfully gcworker stdout | 2022-11-28 09:59:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:47 UTC)" (scheduled at 2022-11-28 09:59:17.016425+00:00) gcworker stdout | 2022-11-28 09:59:17,059 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:59:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:32 UTC)" (scheduled at 2022-11-28 09:59:22.901291+00:00) notificationworker stdout | 2022-11-28 09:59:22,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:59:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:53 UTC)" (scheduled at 2022-11-28 09:59:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:59:23,174 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 09:59:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 09:59:24,494 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:59:24,495 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:59:24,504 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:24,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:59:24,508 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:24,509 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) gunicorn-web stdout | 2022-11-28 09:59:24,568 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:59:24,583 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.104) notificationworker stdout | 2022-11-28 09:59:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:42 UTC)" (scheduled at 2022-11-28 09:59:32.901291+00:00) notificationworker stdout | 2022-11-28 09:59:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:59:33,030 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:33 UTC)" (scheduled at 2022-11-28 09:59:33.026570+00:00) notificationworker stdout | 2022-11-28 09:59:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 09:59:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:33 UTC)" (scheduled at 2022-11-28 09:59:33.321475+00:00) repositorygcworker stdout | 2022-11-28 09:59:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:33 UTC)" executed successfully securityworker stdout | 2022-11-28 09:59:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:07 UTC)" (scheduled at 2022-11-28 09:59:37.716126+00:00) securityworker stdout | 2022-11-28 09:59:37,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 09:59:37,803 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 09:59:37,804 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:59:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:04:38 UTC)" (scheduled at 2022-11-28 09:59:38.024004+00:00) notificationworker stdout | 2022-11-28 09:59:38,064 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:04:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:59:39,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:59:39,490 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:39,494 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:59:39,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 09:59:39,495 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:59:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) gunicorn-web stdout | 2022-11-28 09:59:39,530 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:59:39,532 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) notificationworker stdout | 2022-11-28 09:59:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:52 UTC)" (scheduled at 2022-11-28 09:59:42.901291+00:00) notificationworker stdout | 2022-11-28 09:59:42,977 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 09:59:52 UTC)" executed successfully securityworker stdout | 2022-11-28 09:59:45,912 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:15 UTC)" (scheduled at 2022-11-28 09:59:45.911636+00:00) securityworker stdout | 2022-11-28 09:59:45,982 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:15 UTC)" executed successfully gcworker stdout | 2022-11-28 09:59:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:17 UTC)" (scheduled at 2022-11-28 09:59:47.016425+00:00) gcworker stdout | 2022-11-28 09:59:47,092 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 09:59:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:50 UTC)" (scheduled at 2022-11-28 09:59:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 09:59:50,158 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 09:59:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:51 UTC)" (scheduled at 2022-11-28 09:59:51.733764+00:00) namespacegcworker stdout | 2022-11-28 09:59:51,772 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 09:59:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:02 UTC)" (scheduled at 2022-11-28 09:59:52.901291+00:00) notificationworker stdout | 2022-11-28 09:59:52,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 09:59:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:23 UTC)" (scheduled at 2022-11-28 09:59:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 09:59:53,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 09:59:54,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 09:59:54,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 09:59:54,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:54,506 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 09:59:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:59:54,509 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 09:59:54,560 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 09:59:54,561 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:09:59:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:09:59:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) securityscanningnotificationworker stdout | 2022-11-28 09:59:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:56 UTC)" (scheduled at 2022-11-28 09:59:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:59:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 09:59:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:57 UTC)" (scheduled at 2022-11-28 09:59:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 09:59:57,556 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:00:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:00:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:12 UTC)" (scheduled at 2022-11-28 10:00:02.901291+00:00) notificationworker stdout | 2022-11-28 10:00:02,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:00:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:03 UTC)" (scheduled at 2022-11-28 10:00:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:00:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:00:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:06 UTC)" (scheduled at 2022-11-28 10:00:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:00:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:00:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:37 UTC)" (scheduled at 2022-11-28 10:00:07.716126+00:00) securityworker stdout | 2022-11-28 10:00:07,743 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:00:07,843 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:00:07,844 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:00:09,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:00:09,490 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-web stdout | 2022-11-28 10:00:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:00:09,502 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:00:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:00:09,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:00:09,550 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 10:00:09,552 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.079 118 0.079) notificationworker stdout | 2022-11-28 10:00:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:22 UTC)" (scheduled at 2022-11-28 10:00:12.901291+00:00) notificationworker stdout | 2022-11-28 10:00:12,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:00:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:15 UTC)" (scheduled at 2022-11-28 10:00:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:00:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:00:15,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:45 UTC)" (scheduled at 2022-11-28 10:00:15.911636+00:00) securityworker stdout | 2022-11-28 10:00:15,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:00:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:47 UTC)" (scheduled at 2022-11-28 10:00:17.016425+00:00) gcworker stdout | 2022-11-28 10:00:17,096 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:00:22,904 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:32 UTC)" (scheduled at 2022-11-28 10:00:22.901291+00:00) notificationworker stdout | 2022-11-28 10:00:22,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:00:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:53 UTC)" (scheduled at 2022-11-28 10:00:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:00:23,167 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:00:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:00:24,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:00:24,488 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:00:24,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:24,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:00:24,507 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:00:24,507 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 10:00:24,546 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:00:24,549 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) notificationworker stdout | 2022-11-28 10:00:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:42 UTC)" (scheduled at 2022-11-28 10:00:32.901291+00:00) notificationworker stdout | 2022-11-28 10:00:32,942 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:00:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:33 UTC)" (scheduled at 2022-11-28 10:00:33.026570+00:00) notificationworker stdout | 2022-11-28 10:00:33,031 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:00:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:33 UTC)" (scheduled at 2022-11-28 10:00:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:00:33,342 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:00:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:07 UTC)" (scheduled at 2022-11-28 10:00:37.716126+00:00) securityworker stdout | 2022-11-28 10:00:37,758 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:00:37,815 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:00:37,816 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:00:39,497 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:00:39,497 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:39,512 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:00:39,514 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:39,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:00:39,517 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.092) gunicorn-web stdout | 2022-11-28 10:00:39,568 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:00:39,573 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.097) securityscanningnotificationworker stdout | 2022-11-28 10:00:41,162 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:05:41 UTC)" (scheduled at 2022-11-28 10:00:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:00:41,218 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:05:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:00:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:52 UTC)" (scheduled at 2022-11-28 10:00:42.901291+00:00) notificationworker stdout | 2022-11-28 10:00:42,934 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:00:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:00:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:15 UTC)" (scheduled at 2022-11-28 10:00:45.911636+00:00) securityworker stdout | 2022-11-28 10:00:45,969 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:00:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:17 UTC)" (scheduled at 2022-11-28 10:00:47.016425+00:00) gcworker stdout | 2022-11-28 10:00:47,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:00:48,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:05:48 UTC)" (scheduled at 2022-11-28 10:00:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 10:00:48,087 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:05:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:00:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:50 UTC)" (scheduled at 2022-11-28 10:00:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:00:50,197 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:00:51,781 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:51 UTC)" (scheduled at 2022-11-28 10:00:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:00:51,856 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:00:52,906 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:02 UTC)" (scheduled at 2022-11-28 10:00:52.901291+00:00) notificationworker stdout | 2022-11-28 10:00:53,021 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:00:53,156 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:23 UTC)" (scheduled at 2022-11-28 10:00:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:00:53,222 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:00:54,498 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:00:54,502 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:54,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:54,519 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 159 0.011) gunicorn-web stdout | 2022-11-28 10:00:54,533 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:00:54,536 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:00:54,566 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.088 118 0.088) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:00:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.125 118 0.125) gunicorn-web stdout | 2022-11-28 10:00:54,603 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:00:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 10:00:56,165 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:56 UTC)" (scheduled at 2022-11-28 10:00:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:00:56,165 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:00:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:57 UTC)" (scheduled at 2022-11-28 10:00:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:00:57,549 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:01:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:01:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:12 UTC)" (scheduled at 2022-11-28 10:01:02.901291+00:00) notificationworker stdout | 2022-11-28 10:01:02,966 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:01:03,413 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:03 UTC)" (scheduled at 2022-11-28 10:01:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:01:03,414 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:01:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:06 UTC)" (scheduled at 2022-11-28 10:01:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:01:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:01:07,719 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:37 UTC)" (scheduled at 2022-11-28 10:01:07.716126+00:00) securityworker stdout | 2022-11-28 10:01:07,764 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:01:07,819 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:01:07,819 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:01:09,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:01:09,500 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:01:09,509 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:01:09,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:01:09,512 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:01:09,513 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.082 118 0.082) gunicorn-web stdout | 2022-11-28 10:01:09,556 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) gunicorn-web stdout | 2022-11-28 10:01:09,567 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:01:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:22 UTC)" (scheduled at 2022-11-28 10:01:12.901291+00:00) notificationworker stdout | 2022-11-28 10:01:12,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:01:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:15 UTC)" (scheduled at 2022-11-28 10:01:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:01:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:01:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:45 UTC)" (scheduled at 2022-11-28 10:01:15.911636+00:00) securityworker stdout | 2022-11-28 10:01:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:01:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:47 UTC)" (scheduled at 2022-11-28 10:01:17.016425+00:00) gcworker stdout | 2022-11-28 10:01:17,056 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:47 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:17 +0000] "GET / HTTP/1.1" 200 12465 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.047 1501 0.047) gunicorn-web stdout | 2022-11-28 10:01:17,999 [230] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:17 +0000] "GET / HTTP/1.0" 200 76888 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:19 +0000] "GET /static/ldn/font-awesome.css-a166e3c966c6.css HTTP/1.1" 200 8417 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1456 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:19 +0000] "GET /static/ldn/bootstrap.min.css-13f668494557.css HTTP/1.1" 200 24440 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1457 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:22 +0000] "GET /static/ldn/cssfamilySourceSansPro300400700-30cd793a4b9b.css HTTP/1.1" 200 235 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1471 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:22 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.css-4b15a4ede750.css HTTP/1.1" 200 1482 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1472 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:22 +0000] "GET /static/ldn/cal-heatmap.css-904c3b9e8a60.css HTTP/1.1" 200 799 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1455 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:22 +0000] "GET /static/ldn/ng-tags-input.min.css-7782190f81cd.css HTTP/1.1" 200 1079 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1461 -) notificationworker stdout | 2022-11-28 10:01:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:32 UTC)" (scheduled at 2022-11-28 10:01:22.901291+00:00) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:22 +0000] "GET /static/ldn/jquery.js-3c5c5966471e.js HTTP/1.1" 200 102811 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1434 -) notificationworker stdout | 2022-11-28 10:01:22,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:32 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:23 +0000] "GET /static/ldn/bootstrap.min.js-0e773844b374.js HTTP/1.1" 200 11303 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1441 -) buildlogsarchiver stdout | 2022-11-28 10:01:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:53 UTC)" (scheduled at 2022-11-28 10:01:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:01:23,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:01:53 UTC)" executed successfully nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:23 +0000] "GET /static/ldn/angular.min.js-f0f4228b82f7.js HTTP/1.1" 200 63500 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1439 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/angular-route.min.js-590b72b0eb88.js HTTP/1.1" 200 2248 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1445 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/angular-animate.min.js-636f7a51b2e1.js HTTP/1.1" 200 10309 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1447 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/momentjs-66a52705d33f.js HTTP/1.1" 200 19477 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1433 -) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:01:24,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:01:24,490 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-web stdout | 2022-11-28 10:01:24,493 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:01:24,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/bootstrap-datepicker.min.js-3e3d8e141d5e.js HTTP/1.1" 200 9323 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1452 -) gunicorn-web stdout | 2022-11-28 10:01:24,510 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:01:24,515 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:01:24,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 10:01:24,560 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.js-6612bb423b71.js HTTP/1.1" 200 10832 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1456 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/cal-heatmap.min.js-8ffad728269a.js HTTP/1.1" 200 13004 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1443 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/angular-recaptcha.min.js-23859fca3602.js HTTP/1.1" 200 1793 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1449 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:24 +0000] "GET /static/ldn/ng-tags-input.min.js-fa3026ba8409.js HTTP/1.1" 200 6102 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1445 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/ldn/typeahead.bundle.min.js-716151ca4e5d.js HTTP/1.1" 200 16673 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1448 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/build/main-quay-frontend-c5c926c949af0ae424ce.bundle.js HTTP/1.1" 200 717617 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.086 1460 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/standalonelib/jquery.overscroll.min.js HTTP/1.1" 200 3491 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1443 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/ldn/bootbox4.1.0underscorejs1.5.2restangular1.2.0d3js3.3.3-6d47ddfef9c5.js HTTP/1.1" 200 71199 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1479 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/ldn/raven.min.js-ecd480647a39.js HTTP/1.1" 200 9505 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1437 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:25 +0000] "GET /static/ldn/angular-sanitize.min.js-ff589de0ec1b.js HTTP/1.1" 200 3128 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1448 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:26 +0000] "GET /static/ldn/angular-cookies.min.js-2455ea25d522.js HTTP/1.1" 200 826 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1447 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:26 +0000] "GET /static/img/RedHat.svg HTTP/1.1" 200 1245 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1479 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/135-quay-frontend.chunk.js HTTP/1.1" 200 974 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1437 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/83-quay-frontend.chunk.js HTTP/1.1" 200 1717 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1436 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/18-quay-frontend.chunk.js HTTP/1.1" 200 997 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1436 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.050 1553 0.050) gunicorn-web stdout | 2022-11-28 10:01:30,401 [230] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" gunicorn-web stdout | 2022-11-28 10:01:30,511 [231] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/ HTTP/1.0" 200 595 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/ HTTP/1.1" 200 595 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.179 1550 0.179) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/img/RH_Logo_Quay_Black_UX-horizontal.svg HTTP/1.1" 200 3222 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1505 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/img/network-tile.png HTTP/1.1" 200 6289 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1485 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/181-quay-frontend.chunk.js HTTP/1.1" 200 951 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1437 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/112-quay-frontend.chunk.js HTTP/1.1" 200 767 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1437 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/152-quay-frontend.chunk.js HTTP/1.1" 200 313 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1437 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/build/489e5e00e1a9a80f88d55281894a87ff.woff HTTP/1.1" 200 7280 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.000 1521 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.107 1563 0.107) gunicorn-web stdout | 2022-11-28 10:01:30,762 [231] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.116 1572 0.116) gunicorn-web stdout | 2022-11-28 10:01:30,770 [230] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /static/fonts/fontawesome-webfont.woff2?v=4.7.0 HTTP/1.1" 200 77160 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/static/ldn/font-awesome.css-a166e3c966c6.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.001 1561 -) nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.071 1614 0.071) gunicorn-web stdout | 2022-11-28 10:01:30,943 [231] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:30 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" gunicorn-web stdout | 2022-11-28 10:01:31,003 [230] [INFO] [gunicorn.access] 10.131.0.1 - - [28/Nov/2022:10:01:31 +0000] "GET /api/v1/repository?last_modified=true&namespace=quayadmin&popularity=true"a=false&state=true HTTP/1.0" 200 206 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" nginx stdout | 10.131.0.1 (-) - - [28/Nov/2022:10:01:31 +0000] "GET /api/v1/repository?last_modified=true&namespace=quayadmin&popularity=true"a=false&state=true HTTP/1.1" 200 206 "https://quay-registry-quay-openshift-operators.apps.ocp4.taashee.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" (0.131 1644 0.131) notificationworker stdout | 2022-11-28 10:01:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:42 UTC)" (scheduled at 2022-11-28 10:01:32.901291+00:00) notificationworker stdout | 2022-11-28 10:01:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:01:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:33 UTC)" (scheduled at 2022-11-28 10:01:33.026570+00:00) notificationworker stdout | 2022-11-28 10:01:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:01:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:33 UTC)" (scheduled at 2022-11-28 10:01:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:01:33,348 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:01:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:07 UTC)" (scheduled at 2022-11-28 10:01:37.716126+00:00) securityworker stdout | 2022-11-28 10:01:37,723 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:01:37,769 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:01:37,769 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:01:39,491 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:01:39,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:01:39,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:01:39,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.008) gunicorn-web stdout | 2022-11-28 10:01:39,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:01:39,511 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:01:39,565 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:01:39,566 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.095 118 0.095) notificationworker stdout | 2022-11-28 10:01:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:52 UTC)" (scheduled at 2022-11-28 10:01:42.901291+00:00) notificationworker stdout | 2022-11-28 10:01:42,948 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:01:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:01:45,922 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:15 UTC)" (scheduled at 2022-11-28 10:01:45.911636+00:00) securityworker stdout | 2022-11-28 10:01:45,972 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:01:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:17 UTC)" (scheduled at 2022-11-28 10:01:47.016425+00:00) gcworker stdout | 2022-11-28 10:01:47,061 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:01:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:50 UTC)" (scheduled at 2022-11-28 10:01:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:01:50,153 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:01:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:51 UTC)" (scheduled at 2022-11-28 10:01:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:01:51,768 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:01:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:02 UTC)" (scheduled at 2022-11-28 10:01:52.901291+00:00) notificationworker stdout | 2022-11-28 10:01:52,967 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:01:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:23 UTC)" (scheduled at 2022-11-28 10:01:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:01:53,175 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 10:01:54,494 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:01:54,495 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:01:54,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:01:54,499 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:01:54,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:01:54,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:01:54,558 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 10:01:54,564 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:01:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:01:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.090 118 0.090) securityscanningnotificationworker stdout | 2022-11-28 10:01:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:56 UTC)" (scheduled at 2022-11-28 10:01:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:01:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:01:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:57 UTC)" (scheduled at 2022-11-28 10:01:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:01:57,637 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:02:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:02:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:12 UTC)" (scheduled at 2022-11-28 10:02:02.901291+00:00) notificationworker stdout | 2022-11-28 10:02:02,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:02:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:03 UTC)" (scheduled at 2022-11-28 10:02:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:02:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:02:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:06 UTC)" (scheduled at 2022-11-28 10:02:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:02:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:02:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:37 UTC)" (scheduled at 2022-11-28 10:02:07.716126+00:00) securityworker stdout | 2022-11-28 10:02:07,770 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:02:07,814 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:02:07,814 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:02:09,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:02:09,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:02:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:02:09,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 10:02:09,536 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.074 118 0.074) gunicorn-web stdout | 2022-11-28 10:02:09,546 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:02:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:22 UTC)" (scheduled at 2022-11-28 10:02:12.901291+00:00) notificationworker stdout | 2022-11-28 10:02:12,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:02:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:15 UTC)" (scheduled at 2022-11-28 10:02:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:02:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:02:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:45 UTC)" (scheduled at 2022-11-28 10:02:15.911636+00:00) securityworker stdout | 2022-11-28 10:02:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:02:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:47 UTC)" (scheduled at 2022-11-28 10:02:17.016425+00:00) gcworker stdout | 2022-11-28 10:02:17,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:02:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:32 UTC)" (scheduled at 2022-11-28 10:02:22.901291+00:00) notificationworker stdout | 2022-11-28 10:02:22,993 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:02:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:53 UTC)" (scheduled at 2022-11-28 10:02:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:02:23,164 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:02:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 10:02:24,484 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:02:24,487 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:02:24,492 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:24,494 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:02:24,495 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:02:24,497 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 10:02:24,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 10:02:24,551 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:02:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:42 UTC)" (scheduled at 2022-11-28 10:02:32.901291+00:00) notificationworker stdout | 2022-11-28 10:02:32,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:02:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:33 UTC)" (scheduled at 2022-11-28 10:02:33.026570+00:00) notificationworker stdout | 2022-11-28 10:02:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:02:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:33 UTC)" (scheduled at 2022-11-28 10:02:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:02:33,356 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:02:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:07 UTC)" (scheduled at 2022-11-28 10:02:37.716126+00:00) securityworker stdout | 2022-11-28 10:02:37,732 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:02:37,792 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:02:37,796 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 10:02:39,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:02:39,484 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:02:39,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:39,498 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:39,500 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:02:39,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 10:02:39,534 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:02:39,537 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) notificationworker stdout | 2022-11-28 10:02:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:52 UTC)" (scheduled at 2022-11-28 10:02:42.901291+00:00) notificationworker stdout | 2022-11-28 10:02:42,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:02:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:02:45,915 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:15 UTC)" (scheduled at 2022-11-28 10:02:45.911636+00:00) securityworker stdout | 2022-11-28 10:02:45,965 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:02:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:17 UTC)" (scheduled at 2022-11-28 10:02:47.016425+00:00) gcworker stdout | 2022-11-28 10:02:47,046 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:02:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:50 UTC)" (scheduled at 2022-11-28 10:02:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:02:50,175 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:02:51,736 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:51 UTC)" (scheduled at 2022-11-28 10:02:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:02:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:02:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:02 UTC)" (scheduled at 2022-11-28 10:02:52.901291+00:00) notificationworker stdout | 2022-11-28 10:02:52,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:02:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:23 UTC)" (scheduled at 2022-11-28 10:02:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:02:53,142 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:02:54,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) gunicorn-registry stdout | 2022-11-28 10:02:54,503 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 159 0.010) gunicorn-web stdout | 2022-11-28 10:02:54,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:02:54,515 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:02:54,517 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:02:54,521 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:02:54,566 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.093 118 0.093) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:02:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 10:02:54,569 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:02:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 10:02:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:56 UTC)" (scheduled at 2022-11-28 10:02:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:02:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:02:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:57 UTC)" (scheduled at 2022-11-28 10:02:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:02:57,564 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:03:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:03:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:12 UTC)" (scheduled at 2022-11-28 10:03:02.901291+00:00) notificationworker stdout | 2022-11-28 10:03:02,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:03:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:03 UTC)" (scheduled at 2022-11-28 10:03:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:03:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:03:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:06 UTC)" (scheduled at 2022-11-28 10:03:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:03:06,422 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:03:07,718 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:37 UTC)" (scheduled at 2022-11-28 10:03:07.716126+00:00) securityworker stdout | 2022-11-28 10:03:07,752 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:03:07,799 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:03:07,800 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:03:09,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:03:09,486 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:03:09,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:03:09,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:03:09,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:03:09,502 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:03:09,538 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:03:09,539 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 10:03:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:22 UTC)" (scheduled at 2022-11-28 10:03:12.901291+00:00) notificationworker stdout | 2022-11-28 10:03:12,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:03:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:15 UTC)" (scheduled at 2022-11-28 10:03:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:03:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:03:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:45 UTC)" (scheduled at 2022-11-28 10:03:15.911636+00:00) securityworker stdout | 2022-11-28 10:03:15,950 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:03:17,026 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:47 UTC)" (scheduled at 2022-11-28 10:03:17.016425+00:00) gcworker stdout | 2022-11-28 10:03:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:03:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:32 UTC)" (scheduled at 2022-11-28 10:03:22.901291+00:00) notificationworker stdout | 2022-11-28 10:03:22,951 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:03:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:53 UTC)" (scheduled at 2022-11-28 10:03:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:03:23,170 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:03:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:03:24,486 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:03:24,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:03:24,497 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 10:03:24,501 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.017 162 0.016) gunicorn-web stdout | 2022-11-28 10:03:24,511 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:03:24,515 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 10:03:24,549 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:03:24,556 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) notificationworker stdout | 2022-11-28 10:03:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:42 UTC)" (scheduled at 2022-11-28 10:03:32.901291+00:00) notificationworker stdout | 2022-11-28 10:03:32,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:03:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:33 UTC)" (scheduled at 2022-11-28 10:03:33.026570+00:00) notificationworker stdout | 2022-11-28 10:03:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:03:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:33 UTC)" (scheduled at 2022-11-28 10:03:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:03:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:03:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:07 UTC)" (scheduled at 2022-11-28 10:03:37.716126+00:00) securityworker stdout | 2022-11-28 10:03:37,738 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:03:37,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:03:37,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:03:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:08:38 UTC)" (scheduled at 2022-11-28 10:03:38.420756+00:00) namespacegcworker stdout | 2022-11-28 10:03:38,465 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:08:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:03:39,485 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:03:39,486 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:03:39,495 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:03:39,496 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:03:39,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:03:39,498 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) gunicorn-web stdout | 2022-11-28 10:03:39,538 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:03:39,542 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 10:03:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:52 UTC)" (scheduled at 2022-11-28 10:03:42.901291+00:00) notificationworker stdout | 2022-11-28 10:03:42,935 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:03:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:03:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:15 UTC)" (scheduled at 2022-11-28 10:03:45.911636+00:00) securityworker stdout | 2022-11-28 10:03:45,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:03:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:17 UTC)" (scheduled at 2022-11-28 10:03:47.016425+00:00) gcworker stdout | 2022-11-28 10:03:47,049 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:03:49,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:08:49 UTC)" (scheduled at 2022-11-28 10:03:49.405459+00:00) repositorygcworker stdout | 2022-11-28 10:03:49,435 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:08:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:03:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:50 UTC)" (scheduled at 2022-11-28 10:03:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:03:50,150 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:03:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:51 UTC)" (scheduled at 2022-11-28 10:03:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:03:51,767 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:03:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:02 UTC)" (scheduled at 2022-11-28 10:03:52.901291+00:00) notificationworker stdout | 2022-11-28 10:03:52,924 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:03:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:23 UTC)" (scheduled at 2022-11-28 10:03:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:03:53,159 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:03:54,497 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 162 0.008) gunicorn-registry stdout | 2022-11-28 10:03:54,501 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:03:54,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:03:54,514 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:03:54,516 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:03:54,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 10:03:54,582 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:03:54,610 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:03:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:03:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.139 118 0.139) securityscanningnotificationworker stdout | 2022-11-28 10:03:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:56 UTC)" (scheduled at 2022-11-28 10:03:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:03:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:03:57,516 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:57 UTC)" (scheduled at 2022-11-28 10:03:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:03:57,579 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:04:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:04:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:12 UTC)" (scheduled at 2022-11-28 10:04:02.901291+00:00) notificationworker stdout | 2022-11-28 10:04:02,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:04:03,408 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:03 UTC)" (scheduled at 2022-11-28 10:04:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:04:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:04:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:06 UTC)" (scheduled at 2022-11-28 10:04:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:04:06,426 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:04:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:37 UTC)" (scheduled at 2022-11-28 10:04:07.716126+00:00) securityworker stdout | 2022-11-28 10:04:07,743 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:04:07,813 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:04:07,814 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:04:09,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 10:04:09,492 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:09,498 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:09,500 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:09,507 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:09,510 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:04:09,538 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.065 118 0.065) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.077 118 0.077) gunicorn-web stdout | 2022-11-28 10:04:09,551 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:04:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:22 UTC)" (scheduled at 2022-11-28 10:04:12.901291+00:00) notificationworker stdout | 2022-11-28 10:04:12,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:04:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:15 UTC)" (scheduled at 2022-11-28 10:04:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:04:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:04:15,917 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:45 UTC)" (scheduled at 2022-11-28 10:04:15.911636+00:00) securityworker stdout | 2022-11-28 10:04:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:04:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:47 UTC)" (scheduled at 2022-11-28 10:04:17.016425+00:00) gcworker stdout | 2022-11-28 10:04:17,051 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:04:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:32 UTC)" (scheduled at 2022-11-28 10:04:22.901291+00:00) notificationworker stdout | 2022-11-28 10:04:22,929 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:04:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:53 UTC)" (scheduled at 2022-11-28 10:04:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:04:23,147 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:04:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:04:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:04:24,489 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:24,495 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:24,497 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:24,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:24,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) gunicorn-web stdout | 2022-11-28 10:04:24,558 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:04:24,560 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.089 118 0.089) notificationworker stdout | 2022-11-28 10:04:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:42 UTC)" (scheduled at 2022-11-28 10:04:32.901291+00:00) notificationworker stdout | 2022-11-28 10:04:32,938 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:04:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:33 UTC)" (scheduled at 2022-11-28 10:04:33.026570+00:00) notificationworker stdout | 2022-11-28 10:04:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:04:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:33 UTC)" (scheduled at 2022-11-28 10:04:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:04:33,342 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:04:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:07 UTC)" (scheduled at 2022-11-28 10:04:37.716126+00:00) securityworker stdout | 2022-11-28 10:04:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:04:37,756 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:04:37,756 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:04:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:09:38 UTC)" (scheduled at 2022-11-28 10:04:38.024004+00:00) notificationworker stdout | 2022-11-28 10:04:38,054 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:09:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:04:39,490 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:04:39,492 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:04:39,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:39,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:04:39,505 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:39,507 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 10:04:39,534 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:04:39,541 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068) notificationworker stdout | 2022-11-28 10:04:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:52 UTC)" (scheduled at 2022-11-28 10:04:42.901291+00:00) notificationworker stdout | 2022-11-28 10:04:42,925 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:04:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:04:45,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:15 UTC)" (scheduled at 2022-11-28 10:04:45.911636+00:00) securityworker stdout | 2022-11-28 10:04:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:04:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:17 UTC)" (scheduled at 2022-11-28 10:04:47.016425+00:00) gcworker stdout | 2022-11-28 10:04:47,057 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:04:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:50 UTC)" (scheduled at 2022-11-28 10:04:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:04:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:04:51,738 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:51 UTC)" (scheduled at 2022-11-28 10:04:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:04:51,778 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:04:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:02 UTC)" (scheduled at 2022-11-28 10:04:52.901291+00:00) notificationworker stdout | 2022-11-28 10:04:52,926 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:04:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:23 UTC)" (scheduled at 2022-11-28 10:04:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:04:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:04:54,482 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:54,492 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:04:54,494 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:54,495 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:04:54,500 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:04:54,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.091 118 0.091) gunicorn-web stdout | 2022-11-28 10:04:54,563 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:04:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 10:04:54,569 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:04:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 10:04:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:56 UTC)" (scheduled at 2022-11-28 10:04:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:04:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:04:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:57 UTC)" (scheduled at 2022-11-28 10:04:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:04:57,601 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:05:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:05:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:12 UTC)" (scheduled at 2022-11-28 10:05:02.901291+00:00) notificationworker stdout | 2022-11-28 10:05:02,927 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:05:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:03 UTC)" (scheduled at 2022-11-28 10:05:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:05:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:05:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:06 UTC)" (scheduled at 2022-11-28 10:05:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:05:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:05:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:37 UTC)" (scheduled at 2022-11-28 10:05:07.716126+00:00) securityworker stdout | 2022-11-28 10:05:07,729 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:05:07,836 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:05:07,837 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:05:09,487 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) gunicorn-registry stdout | 2022-11-28 10:05:09,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 10:05:09,503 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:09,505 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:05:09,514 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:09,516 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:05:09,544 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.072 118 0.072) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 10:05:09,557 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:05:12,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:22 UTC)" (scheduled at 2022-11-28 10:05:12.901291+00:00) notificationworker stdout | 2022-11-28 10:05:12,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:05:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:15 UTC)" (scheduled at 2022-11-28 10:05:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:05:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:05:15,914 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:45 UTC)" (scheduled at 2022-11-28 10:05:15.911636+00:00) securityworker stdout | 2022-11-28 10:05:16,039 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:05:17,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:47 UTC)" (scheduled at 2022-11-28 10:05:17.016425+00:00) gcworker stdout | 2022-11-28 10:05:17,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:05:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:32 UTC)" (scheduled at 2022-11-28 10:05:22.901291+00:00) notificationworker stdout | 2022-11-28 10:05:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:05:23,119 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:53 UTC)" (scheduled at 2022-11-28 10:05:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:05:23,165 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:05:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:05:24,482 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:05:24,491 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:24,493 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:05:24,493 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:24,495 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-registry stdout | 2022-11-28 10:05:24,497 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.060 118 0.060) gunicorn-web stdout | 2022-11-28 10:05:24,531 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.096 118 0.096) gunicorn-web stdout | 2022-11-28 10:05:24,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:05:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:42 UTC)" (scheduled at 2022-11-28 10:05:32.901291+00:00) notificationworker stdout | 2022-11-28 10:05:32,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:05:33,027 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:33 UTC)" (scheduled at 2022-11-28 10:05:33.026570+00:00) notificationworker stdout | 2022-11-28 10:05:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:05:33,327 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:33 UTC)" (scheduled at 2022-11-28 10:05:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:05:33,406 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:05:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:07 UTC)" (scheduled at 2022-11-28 10:05:37.716126+00:00) securityworker stdout | 2022-11-28 10:05:37,722 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:05:37,779 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:05:37,780 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) gunicorn-registry stdout | 2022-11-28 10:05:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.011 162 0.011) gunicorn-registry stdout | 2022-11-28 10:05:39,494 [241] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:05:39,506 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:39,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 10:05:39,513 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:39,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.083 118 0.083) gunicorn-web stdout | 2022-11-28 10:05:39,554 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.114 118 0.109) gunicorn-web stdout | 2022-11-28 10:05:39,587 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 10:05:41,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:10:41 UTC)" (scheduled at 2022-11-28 10:05:41.161461+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:05:41,201 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:10:41 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:05:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:52 UTC)" (scheduled at 2022-11-28 10:05:42.901291+00:00) notificationworker stdout | 2022-11-28 10:05:42,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:05:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:05:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:15 UTC)" (scheduled at 2022-11-28 10:05:45.911636+00:00) securityworker stdout | 2022-11-28 10:05:45,992 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:05:47,025 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:17 UTC)" (scheduled at 2022-11-28 10:05:47.016425+00:00) gcworker stdout | 2022-11-28 10:05:47,315 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:05:48,035 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:10:48 UTC)" (scheduled at 2022-11-28 10:05:48.034592+00:00) exportactionlogsworker stdout | 2022-11-28 10:05:48,091 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:10:48 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:05:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:50 UTC)" (scheduled at 2022-11-28 10:05:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:05:50,164 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:05:51,740 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:51 UTC)" (scheduled at 2022-11-28 10:05:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:05:51,838 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:05:52,923 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:02 UTC)" (scheduled at 2022-11-28 10:05:52.901291+00:00) notificationworker stdout | 2022-11-28 10:05:53,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:05:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:23 UTC)" (scheduled at 2022-11-28 10:05:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:05:53,153 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:05:54,496 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.013 162 0.013) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:05:54,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:54,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 10:05:54,515 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:05:54,532 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:05:54,536 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.087 118 0.087) gunicorn-web stdout | 2022-11-28 10:05:54,559 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:05:54,592 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:05:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:05:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.120 118 0.120) securityscanningnotificationworker stdout | 2022-11-28 10:05:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:56 UTC)" (scheduled at 2022-11-28 10:05:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:05:56,163 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:05:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:57 UTC)" (scheduled at 2022-11-28 10:05:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:05:57,543 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:06:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:06:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:12 UTC)" (scheduled at 2022-11-28 10:06:02.901291+00:00) notificationworker stdout | 2022-11-28 10:06:02,941 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:06:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:03 UTC)" (scheduled at 2022-11-28 10:06:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:06:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:06:06,424 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:06 UTC)" (scheduled at 2022-11-28 10:06:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:06:06,424 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:06:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:37 UTC)" (scheduled at 2022-11-28 10:06:07.716126+00:00) securityworker stdout | 2022-11-28 10:06:07,721 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:06:07,784 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:06:07,784 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:37 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:06:09,488 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:06:09,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:06:09,498 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:06:09,499 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:06:09,500 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:06:09,501 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.059 118 0.059) gunicorn-web stdout | 2022-11-28 10:06:09,531 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.061 118 0.061) gunicorn-web stdout | 2022-11-28 10:06:09,534 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:06:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:22 UTC)" (scheduled at 2022-11-28 10:06:12.901291+00:00) notificationworker stdout | 2022-11-28 10:06:12,923 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:06:15,037 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:15 UTC)" (scheduled at 2022-11-28 10:06:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:06:15,038 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:06:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:45 UTC)" (scheduled at 2022-11-28 10:06:15.911636+00:00) securityworker stdout | 2022-11-28 10:06:16,010 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:06:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:47 UTC)" (scheduled at 2022-11-28 10:06:17.016425+00:00) gcworker stdout | 2022-11-28 10:06:17,085 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:06:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:32 UTC)" (scheduled at 2022-11-28 10:06:22.901291+00:00) notificationworker stdout | 2022-11-28 10:06:22,932 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:06:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:53 UTC)" (scheduled at 2022-11-28 10:06:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:06:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:06:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 10:06:24,491 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:06:24,493 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.009 162 0.009) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:06:24,510 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:06:24,510 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 159 0.006) gunicorn-web stdout | 2022-11-28 10:06:24,512 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:06:24,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.084 118 0.084) gunicorn-web stdout | 2022-11-28 10:06:24,556 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:06:24,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) notificationworker stdout | 2022-11-28 10:06:32,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:42 UTC)" (scheduled at 2022-11-28 10:06:32.901291+00:00) notificationworker stdout | 2022-11-28 10:06:32,928 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:06:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:33 UTC)" (scheduled at 2022-11-28 10:06:33.026570+00:00) notificationworker stdout | 2022-11-28 10:06:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:06:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:33 UTC)" (scheduled at 2022-11-28 10:06:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:06:33,346 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:06:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:07 UTC)" (scheduled at 2022-11-28 10:06:37.716126+00:00) securityworker stdout | 2022-11-28 10:06:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:06:37,781 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:06:37,786 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:06:39,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 10:06:39,497 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:06:39,501 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:06:39,504 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:06:39,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:06:39,514 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:06:39,534 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) gunicorn-web stdout | 2022-11-28 10:06:39,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:06:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:52 UTC)" (scheduled at 2022-11-28 10:06:42.901291+00:00) notificationworker stdout | 2022-11-28 10:06:42,930 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:06:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:06:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:15 UTC)" (scheduled at 2022-11-28 10:06:45.911636+00:00) securityworker stdout | 2022-11-28 10:06:45,959 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:06:47,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:17 UTC)" (scheduled at 2022-11-28 10:06:47.016425+00:00) gcworker stdout | 2022-11-28 10:06:47,053 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:06:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:50 UTC)" (scheduled at 2022-11-28 10:06:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:06:50,163 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:06:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:51 UTC)" (scheduled at 2022-11-28 10:06:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:06:51,773 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:06:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:02 UTC)" (scheduled at 2022-11-28 10:06:52.901291+00:00) notificationworker stdout | 2022-11-28 10:06:52,957 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:06:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:23 UTC)" (scheduled at 2022-11-28 10:06:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:06:53,169 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:23 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:06:54,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:06:54,489 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:06:54,503 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:06:54,505 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:06:54,506 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:06:54,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.080 118 0.080) gunicorn-web stdout | 2022-11-28 10:06:54,553 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:06:54,558 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:06:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:06:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.086 118 0.086) securityscanningnotificationworker stdout | 2022-11-28 10:06:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:56 UTC)" (scheduled at 2022-11-28 10:06:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:06:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:06:57,515 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:57 UTC)" (scheduled at 2022-11-28 10:06:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:06:57,553 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:07:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:07:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:12 UTC)" (scheduled at 2022-11-28 10:07:02.901291+00:00) notificationworker stdout | 2022-11-28 10:07:02,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:07:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:03 UTC)" (scheduled at 2022-11-28 10:07:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:07:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:07:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:06 UTC)" (scheduled at 2022-11-28 10:07:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:07:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:07:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:37 UTC)" (scheduled at 2022-11-28 10:07:07.716126+00:00) securityworker stdout | 2022-11-28 10:07:07,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:07:07,756 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:07:07,757 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:07:09,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.014 162 0.014) gunicorn-registry stdout | 2022-11-28 10:07:09,500 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.008 159 0.008) gunicorn-web stdout | 2022-11-28 10:07:09,509 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:07:09,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.005) gunicorn-web stdout | 2022-11-28 10:07:09,529 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:09,536 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.073 118 0.073) gunicorn-web stdout | 2022-11-28 10:07:09,546 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.103 118 0.103) gunicorn-web stdout | 2022-11-28 10:07:09,575 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:07:12,935 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:22 UTC)" (scheduled at 2022-11-28 10:07:12.901291+00:00) notificationworker stdout | 2022-11-28 10:07:12,987 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:07:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:15 UTC)" (scheduled at 2022-11-28 10:07:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:07:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:07:15,918 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:45 UTC)" (scheduled at 2022-11-28 10:07:15.911636+00:00) securityworker stdout | 2022-11-28 10:07:15,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:07:17,020 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:47 UTC)" (scheduled at 2022-11-28 10:07:17.016425+00:00) gcworker stdout | 2022-11-28 10:07:17,049 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:07:22,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:32 UTC)" (scheduled at 2022-11-28 10:07:22.901291+00:00) notificationworker stdout | 2022-11-28 10:07:22,953 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:07:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:53 UTC)" (scheduled at 2022-11-28 10:07:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:07:23,149 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:07:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:07:24,489 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:07:24,497 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:24,498 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2022-11-28 10:07:24,499 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:07:24,502 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:24,505 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:07:24,540 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.066 118 0.066) gunicorn-web stdout | 2022-11-28 10:07:24,542 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.067 118 0.067) notificationworker stdout | 2022-11-28 10:07:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:42 UTC)" (scheduled at 2022-11-28 10:07:32.901291+00:00) notificationworker stdout | 2022-11-28 10:07:32,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:07:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:33 UTC)" (scheduled at 2022-11-28 10:07:33.026570+00:00) notificationworker stdout | 2022-11-28 10:07:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:07:33,323 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:33 UTC)" (scheduled at 2022-11-28 10:07:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:07:33,351 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:07:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:07 UTC)" (scheduled at 2022-11-28 10:07:37.716126+00:00) securityworker stdout | 2022-11-28 10:07:37,724 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:07:37,766 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:07:37,767 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:07 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:07:39,489 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:07:39,489 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:39,500 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:07:39,503 [226] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:07:39,504 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:07:39,508 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 10:07:39,541 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.076 118 0.076) gunicorn-web stdout | 2022-11-28 10:07:39,548 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:07:42,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:52 UTC)" (scheduled at 2022-11-28 10:07:42.901291+00:00) notificationworker stdout | 2022-11-28 10:07:42,936 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:07:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:07:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:15 UTC)" (scheduled at 2022-11-28 10:07:45.911636+00:00) securityworker stdout | 2022-11-28 10:07:45,957 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:07:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:17 UTC)" (scheduled at 2022-11-28 10:07:47.016425+00:00) gcworker stdout | 2022-11-28 10:07:47,105 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:17 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:07:50,130 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:50 UTC)" (scheduled at 2022-11-28 10:07:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:07:50,166 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:07:51,734 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:51 UTC)" (scheduled at 2022-11-28 10:07:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:07:51,754 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:07:52,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:02 UTC)" (scheduled at 2022-11-28 10:07:52.901291+00:00) notificationworker stdout | 2022-11-28 10:07:52,944 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:07:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:23 UTC)" (scheduled at 2022-11-28 10:07:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:07:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:07:54,486 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-registry stdout | 2022-11-28 10:07:54,499 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.002) gunicorn-web stdout | 2022-11-28 10:07:54,502 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:54,506 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.004) gunicorn-web stdout | 2022-11-28 10:07:54,519 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:07:54,521 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:07:54,574 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.101 118 0.101) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:07:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.104 118 0.103) gunicorn-web stdout | 2022-11-28 10:07:54,581 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:07:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" securityscanningnotificationworker stdout | 2022-11-28 10:07:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:56 UTC)" (scheduled at 2022-11-28 10:07:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:07:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:07:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:57 UTC)" (scheduled at 2022-11-28 10:07:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:07:57,546 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:08:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:08:02,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:12 UTC)" (scheduled at 2022-11-28 10:08:02.901291+00:00) notificationworker stdout | 2022-11-28 10:08:02,945 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:08:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:03 UTC)" (scheduled at 2022-11-28 10:08:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:08:03,408 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:08:06,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:06 UTC)" (scheduled at 2022-11-28 10:08:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:08:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:08:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:37 UTC)" (scheduled at 2022-11-28 10:08:07.716126+00:00) securityworker stdout | 2022-11-28 10:08:07,727 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:08:07,772 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:08:07,776 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.005) gunicorn-registry stdout | 2022-11-28 10:08:09,488 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:08:09,492 [242] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.010 162 0.010) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.005) gunicorn-web stdout | 2022-11-28 10:08:09,506 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:08:09,507 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.003) gunicorn-web stdout | 2022-11-28 10:08:09,509 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:09,510 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.075 118 0.075) gunicorn-web stdout | 2022-11-28 10:08:09,549 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 10:08:09,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:08:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:22 UTC)" (scheduled at 2022-11-28 10:08:12.901291+00:00) notificationworker stdout | 2022-11-28 10:08:12,924 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:08:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:15 UTC)" (scheduled at 2022-11-28 10:08:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:08:15,037 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:08:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:45 UTC)" (scheduled at 2022-11-28 10:08:15.911636+00:00) securityworker stdout | 2022-11-28 10:08:15,952 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:08:17,017 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:47 UTC)" (scheduled at 2022-11-28 10:08:17.016425+00:00) gcworker stdout | 2022-11-28 10:08:17,063 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:08:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:32 UTC)" (scheduled at 2022-11-28 10:08:22.901291+00:00) notificationworker stdout | 2022-11-28 10:08:22,939 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:08:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:53 UTC)" (scheduled at 2022-11-28 10:08:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:08:23,160 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:08:53 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.002) gunicorn-registry stdout | 2022-11-28 10:08:24,486 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:08:24,488 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:08:24,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:08:24,500 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:24,516 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 159 0.006) gunicorn-web stdout | 2022-11-28 10:08:24,519 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:24,558 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.085 118 0.085) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.117 118 0.117) gunicorn-web stdout | 2022-11-28 10:08:24,590 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:08:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:42 UTC)" (scheduled at 2022-11-28 10:08:32.901291+00:00) notificationworker stdout | 2022-11-28 10:08:32,943 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:08:33,028 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:33 UTC)" (scheduled at 2022-11-28 10:08:33.026570+00:00) notificationworker stdout | 2022-11-28 10:08:33,028 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:08:33,328 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:33 UTC)" (scheduled at 2022-11-28 10:08:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:08:33,362 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:08:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:07 UTC)" (scheduled at 2022-11-28 10:08:37.716126+00:00) securityworker stdout | 2022-11-28 10:08:37,755 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:08:37,811 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:08:37,812 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:07 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:08:38,422 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:13:38 UTC)" (scheduled at 2022-11-28 10:08:38.420756+00:00) namespacegcworker stdout | 2022-11-28 10:08:38,470 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:13:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 10:08:39,485 [244] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:08:39,485 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.006 162 0.006) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:08:39,496 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:08:39,498 [230] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 159 0.004) gunicorn-web stdout | 2022-11-28 10:08:39,499 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:08:39,501 [228] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:39,530 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.056 118 0.056) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.062 118 0.062) gunicorn-web stdout | 2022-11-28 10:08:39,534 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:08:42,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:52 UTC)" (scheduled at 2022-11-28 10:08:42.901291+00:00) notificationworker stdout | 2022-11-28 10:08:42,933 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:08:52 UTC)" executed successfully securityworker stdout | 2022-11-28 10:08:45,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:15 UTC)" (scheduled at 2022-11-28 10:08:45.911636+00:00) securityworker stdout | 2022-11-28 10:08:45,966 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:15 UTC)" executed successfully gcworker stdout | 2022-11-28 10:08:47,018 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:17 UTC)" (scheduled at 2022-11-28 10:08:47.016425+00:00) gcworker stdout | 2022-11-28 10:08:47,082 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:17 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:08:49,406 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:13:49 UTC)" (scheduled at 2022-11-28 10:08:49.405459+00:00) repositorygcworker stdout | 2022-11-28 10:08:49,439 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:13:49 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:08:50,129 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:50 UTC)" (scheduled at 2022-11-28 10:08:50.128640+00:00) exportactionlogsworker stdout | 2022-11-28 10:08:50,154 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:50 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:08:51,735 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:51 UTC)" (scheduled at 2022-11-28 10:08:51.733764+00:00) namespacegcworker stdout | 2022-11-28 10:08:51,766 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:51 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:08:52,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:02 UTC)" (scheduled at 2022-11-28 10:08:52.901291+00:00) notificationworker stdout | 2022-11-28 10:08:52,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:02 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:08:53,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:23 UTC)" (scheduled at 2022-11-28 10:08:53.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:08:53,141 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:23 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:08:54,484 [240] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:08:54,488 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.007) gunicorn-web stdout | 2022-11-28 10:08:54,500 [226] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:08:54,502 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:54,509 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 159 0.008) gunicorn-web stdout | 2022-11-28 10:08:54,513 [230] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:08:54,569 [230] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:08:54,570 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:08:54 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.097 118 0.097) nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:08:54 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.098 118 0.098) securityscanningnotificationworker stdout | 2022-11-28 10:08:56,163 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:56 UTC)" (scheduled at 2022-11-28 10:08:56.162152+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:08:56,164 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:56 UTC)" executed successfully securityscanningnotificationworker stdout | 2022-11-28 10:08:57,514 [93] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:57 UTC)" (scheduled at 2022-11-28 10:08:57.513149+00:00) securityscanningnotificationworker stdout | 2022-11-28 10:08:57,545 [93] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:09:57 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:09:02,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:12 UTC)" (scheduled at 2022-11-28 10:09:02.901291+00:00) notificationworker stdout | 2022-11-28 10:09:02,950 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:12 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:09:03,407 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:03 UTC)" (scheduled at 2022-11-28 10:09:03.406131+00:00) repositorygcworker stdout | 2022-11-28 10:09:03,407 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:03 UTC)" executed successfully namespacegcworker stdout | 2022-11-28 10:09:06,423 [74] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:06 UTC)" (scheduled at 2022-11-28 10:09:06.421235+00:00) namespacegcworker stdout | 2022-11-28 10:09:06,423 [74] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:06 UTC)" executed successfully securityworker stdout | 2022-11-28 10:09:07,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:37 UTC)" (scheduled at 2022-11-28 10:09:07.716126+00:00) securityworker stdout | 2022-11-28 10:09:07,726 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:09:07,761 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:09:07,762 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:37 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.005 162 0.005) gunicorn-registry stdout | 2022-11-28 10:09:09,497 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.012 162 0.012) gunicorn-registry stdout | 2022-11-28 10:09:09,504 [245] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:09:09,509 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:09:09,511 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:09:09,516 [228] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:09:09,517 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.069 118 0.069) gunicorn-web stdout | 2022-11-28 10:09:09,550 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:09:09,550 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:09 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:09 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.070 118 0.070) notificationworker stdout | 2022-11-28 10:09:12,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:22 UTC)" (scheduled at 2022-11-28 10:09:12.901291+00:00) notificationworker stdout | 2022-11-28 10:09:12,940 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:22 UTC)" executed successfully exportactionlogsworker stdout | 2022-11-28 10:09:15,036 [64] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:15 UTC)" (scheduled at 2022-11-28 10:09:15.035126+00:00) exportactionlogsworker stdout | 2022-11-28 10:09:15,036 [64] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:15 UTC)" executed successfully securityworker stdout | 2022-11-28 10:09:15,913 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:45 UTC)" (scheduled at 2022-11-28 10:09:15.911636+00:00) securityworker stdout | 2022-11-28 10:09:15,968 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:45 UTC)" executed successfully gcworker stdout | 2022-11-28 10:09:17,024 [65] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:47 UTC)" (scheduled at 2022-11-28 10:09:17.016425+00:00) gcworker stdout | 2022-11-28 10:09:17,066 [65] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:47 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:09:22,902 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:32 UTC)" (scheduled at 2022-11-28 10:09:22.901291+00:00) notificationworker stdout | 2022-11-28 10:09:22,937 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:32 UTC)" executed successfully buildlogsarchiver stdout | 2022-11-28 10:09:23,115 [60] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:53 UTC)" (scheduled at 2022-11-28 10:09:23.113782+00:00) buildlogsarchiver stdout | 2022-11-28 10:09:23,143 [60] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-11-28 10:09:53 UTC)" executed successfully gunicorn-registry stdout | 2022-11-28 10:09:24,487 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.007 162 0.007) gunicorn-registry stdout | 2022-11-28 10:09:24,490 [243] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 10:09:24,499 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:09:24,501 [231] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-11-28 10:09:24,511 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 159 0.003) gunicorn-web stdout | 2022-11-28 10:09:24,516 [226] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.078 118 0.078) gunicorn-web stdout | 2022-11-28 10:09:24,551 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:24 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.119 118 0.119) gunicorn-web stdout | 2022-11-28 10:09:24,590 [226] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:24 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" notificationworker stdout | 2022-11-28 10:09:32,903 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:42 UTC)" (scheduled at 2022-11-28 10:09:32.901291+00:00) notificationworker stdout | 2022-11-28 10:09:32,962 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-11-28 10:09:42 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:09:33,029 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:33 UTC)" (scheduled at 2022-11-28 10:09:33.026570+00:00) notificationworker stdout | 2022-11-28 10:09:33,029 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:33 UTC)" executed successfully repositorygcworker stdout | 2022-11-28 10:09:33,322 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:33 UTC)" (scheduled at 2022-11-28 10:09:33.321475+00:00) repositorygcworker stdout | 2022-11-28 10:09:33,350 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-11-28 10:10:33 UTC)" executed successfully securityworker stdout | 2022-11-28 10:09:37,717 [94] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:10:07 UTC)" (scheduled at 2022-11-28 10:09:37.716126+00:00) securityworker stdout | 2022-11-28 10:09:37,735 [94] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'. securityworker stdout | 2022-11-28 10:09:37,808 [94] [ERROR] [workers.worker] Operation raised exception securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/workers/worker.py", line 87, in _operation_func securityworker stdout | return operation_func() securityworker stdout | File "/quay-registry/workers/securityworker/securityworker.py", line 45, in _index_recent_manifests_in_scanner securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/__init__.py", line 46, in perform_indexing_recent_manifests securityworker stdout | self._model.perform_indexing_recent_manifests(batch_size) securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 251, in perform_indexing_recent_manifests securityworker stdout | start_index = max(end_index - batch_size, 1) securityworker stdout | TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' securityworker stdout | 2022-11-28 10:09:37,808 [94] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2022-11-28 10:10:07 UTC)" executed successfully notificationworker stdout | 2022-11-28 10:09:38,025 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:14:38 UTC)" (scheduled at 2022-11-28 10:09:38.024004+00:00) notificationworker stdout | 2022-11-28 10:09:38,096 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-11-28 10:14:38 UTC)" executed successfully nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.003 162 0.003) gunicorn-registry stdout | 2022-11-28 10:09:39,483 [246] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" gunicorn-registry stdout | 2022-11-28 10:09:39,483 [247] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.004 162 0.004) gunicorn-web stdout | 2022-11-28 10:09:39,492 [231] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" gunicorn-web stdout | 2022-11-28 10:09:39,494 [231] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:09:39,496 [230] [INFO] [gunicorn.access] 127.0.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.27.1" nginx stdout | 127.0.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.27.1" (0.002 159 0.002) gunicorn-web stdout | 2022-11-28 10:09:39,498 [228] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.064 118 0.064) gunicorn-web stdout | 2022-11-28 10:09:39,537 [231] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" gunicorn-web stdout | 2022-11-28 10:09:39,540 [228] [INFO] [gunicorn.access] 10.130.0.1 - - [28/Nov/2022:10:09:39 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.24" nginx stdout | 10.130.0.1 (-) - - [28/Nov/2022:10:09:39 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.24" (0.068 118 0.068)