2017/02/13 04:30:51 [warn] 1#1: [lua] util.lua:61: system(): os execute stderr: 2017/02/13 04:31:31 [error] 22#22: *13 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:31:31 [warn] 22#22: *13 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:31:31 [error] 22#22: *13 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:31:31 [error] 22#22: *13 attempt to set ngx.status after sending out response headers, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:31:31 [warn] 22#22: *13 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" [13/Feb/2017:04:31:31 -0500] api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com:8080 10.128.0.1:47166 "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1" 404 5 (0.024) 0 2017/02/13 04:32:00 [error] 23#23: *80 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET / HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:32:00 [warn] 23#23: *80 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET / HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:32:00 [error] 23#23: *80 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET / HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:32:00 [error] 23#23: *80 attempt to set ngx.status after sending out response headers, client: 10.128.0.1, server: _, request: "GET / HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:32:00 [warn] 23#23: *80 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET / HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" [13/Feb/2017:04:32:00 -0500] api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com:8080 10.128.0.1:47348 "GET / HTTP/1.1" 404 5 (0.024) 0 2017/02/13 04:32:55 [error] 25#25: *106 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 25#25: *106 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 23#23: *114 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 22#22: *130 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 23#23: *114 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 19#19: *97 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 22#22: *130 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 19#19: *97 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 24#24: *102 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 24#24: *102 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 26#26: *127 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 26#26: *127 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 20#20: *110 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 20#20: *110 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:32:55 [error] 21#21: *94 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:32:55 [error] 21#21: *94 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 19#19: *210 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 19#19: *210 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 21#21: *206 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 21#21: *206 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 20#20: *214 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 20#20: *214 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 23#23: *224 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 23#23: *224 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 22#22: *236 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 22#22: *236 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 25#25: *229 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 25#25: *229 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 26#26: *228 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 26#26: *228 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:33:58 [error] 24#24: *249 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:33:58 [error] 24#24: *249 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:34:57 [error] 23#23: *318 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:34:57 [error] 23#23: *318 lua entry thread aborted: runtime error: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration stack traceback: coroutine 0: [C]: in function 'error' /opt/app-root/src/src/configuration_loader.lua:16: in function 'boot' /opt/app-root/src/src/apicast.lua:106: in function 'call' rewrite_by_lua(apicast.conf:75):1: in function , client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:34:57 [error] 23#23: *318 [lua] proxy.lua:149: find_service(): service not found for host abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:34:57 [error] 23#23: *318 attempt to set ngx.status after sending out response headers, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:34:57 [warn] 23#23: *318 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" [13/Feb/2017:04:34:57 -0500] abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com:8080 10.128.0.1:48540 "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1" 500 199 (3.051) 0 2017/02/13 04:35:01 [error] 19#19: *331 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 19#19: *331 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 21#21: *335 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 21#21: *335 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 20#20: *345 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 20#20: *345 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 23#23: *362 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 23#23: *362 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 22#22: *352 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 22#22: *352 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 25#25: *359 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 25#25: *359 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 26#26: *370 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 26#26: *370 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:01 [error] 24#24: *389 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:35:01 [error] 24#24: *389 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:35:41 [error] 26#26: *441 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:35:41 [error] 26#26: *441 lua entry thread aborted: runtime error: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration stack traceback: coroutine 0: [C]: in function 'error' /opt/app-root/src/src/configuration_loader.lua:16: in function 'boot' /opt/app-root/src/src/apicast.lua:106: in function 'call' rewrite_by_lua(apicast.conf:75):1: in function , client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:35:41 [error] 26#26: *441 [lua] proxy.lua:149: find_service(): service not found for host abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:35:41 [error] 26#26: *441 attempt to set ngx.status after sending out response headers, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:35:41 [warn] 26#26: *441 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1", host: "abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com" [13/Feb/2017:04:35:41 -0500] abcd-2-3scale-staging.cloudapps.api-qe.eng.rdu2.redhat.com:8080 10.128.0.1:48842 "GET /?user_key=e7e7cb2dbdb6898d9180c3542bfac653 HTTP/1.1" 500 199 (3.049) 0 2017/02/13 04:36:04 [error] 19#19: *457 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 19#19: *457 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 21#21: *461 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 21#21: *461 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 20#20: *477 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 20#20: *477 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 23#23: *481 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 23#23: *481 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 25#25: *489 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 22#22: *482 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 22#22: *482 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 25#25: *489 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 26#26: *496 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 26#26: *496 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:36:04 [error] 24#24: *509 [lua] remote_v1.lua:155: curl(): configuration download error curl: (27) Out of memory 27, context: ngx.timer 2017/02/13 04:36:04 [error] 24#24: *509 [lua] apicast.lua:88: auto updating configuration failed with: /opt/app-root/src/src/configuration_loader.lua:16: missing configuration, context: ngx.timer 2017/02/13 04:39:25 [error] 20#20: *828 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:39:25 [warn] 20#20: *828 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:39:25 [error] 20#20: *828 [lua] proxy.lua:149: find_service(): service not found for host api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:39:25 [error] 20#20: *828 attempt to set ngx.status after sending out response headers, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" 2017/02/13 04:39:25 [warn] 20#20: *828 [lua] proxy.lua:111: error_service_not_found(): could not find service for host: api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com, client: 10.128.0.1, server: _, request: "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1", host: "api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com" [13/Feb/2017:04:39:25 -0500] api-2-3scale.cloudapps.api-qe.eng.rdu2.redhat.com:8080 10.128.0.1:50414 "GET /?user_key=f2813a44757081e56a1d4be3d21d12af HTTP/1.1" 404 5 (0.037) 0