1. Failure - 'curl' call:
$ time curl -v -k -X POST -H "Cache-Control: no-cache" --data "$(head -c 50K < /dev/urandom | tr -dc A-Za-z0-9)" "https://proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster:443/?user_key=e9739231309c39d91db6695015b30214" 2>&1 | grep -v "url"
Note: Unnecessary use of -X or --request, POST is already inferred.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 10.0.1.3...
* TCP_NODELAY set
* Connected to proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster (10.0.1.3) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
} [5 bytes data]
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
} [512 bytes data]
* TLSv1.3 (IN), TLS handshake, Server hello (2):
{ [93 bytes data]
* TLSv1.2 (IN), TLS handshake, Certificate (11):
{ [2336 bytes data]
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
{ [333 bytes data]
* TLSv1.2 (IN), TLS handshake, Server finished (14):
{ [4 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
} [70 bytes data]
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
} [1 bytes data]
* TLSv1.2 (OUT), TLS handshake, Finished (20):
} [16 bytes data]
* TLSv1.2 (IN), TLS handshake, Finished (20):
{ [16 bytes data]
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server did not agree to a protocol
* Server certificate:
* subject: CN=*.apps.ocp3-11.cluster
* start date: Aug 5 15:12:14 2019 GMT
* expire date: Aug 4 15:12:15 2021 GMT
* issuer: CN=openshift-signer@1565016381
* SSL certificate verify result: self signed certificate in certificate chain (19), continuing anyway.
} [5 bytes data]
> POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1
> Host: proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster
> Accept: */*
> Cache-Control: no-cache
> Content-Length: 12654
> Expect: 100-continue
>
{ [5 bytes data]
< HTTP/1.1 100 Continue
} [5 bytes data]
* We are completely uploaded and fine
100 12654 0 0 100 12654 0 209 0:01:00 0:01:00 --:--:-- 0{ [5 bytes data]
< HTTP/1.1 502 Bad Gateway
< Server: openresty/1.13.6.1
< Date: Wed, 06 Nov 2019 22:26:14 GMT
< Content-Type: text/html
< Content-Length: 170
< Set-Cookie: 4f2d9edb621b32397f90ee30164736e3=af07acb70b66fed6ccd8b5ea641f75bf; path=/; HttpOnly
<
{ [170 bytes data]
100 12824 100 170 100 12654 2 206 0:01:25 0:01:01 0:00:24 43
* Connection #0 to host proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster left intact
502 Bad Gateway
502 Bad Gateway
openresty
real 1m1.199s
user 0m0.033s
sys 0m0.032s
---
2. Failure - Proxy Logs:
CONNECT Nov 06 19:25:12 [1740]: Connect (file descriptor 6): gateway [10.0.1.1]
CONNECT Nov 06 19:25:12 [1740]: Request (file descriptor 6): GET http://172.30.90.138:3000/transactions/authrep.xml?service_token=dfbb0aacb2a772cccc0b03aad920c146d3637643590c013840ad5fe1019f54e5&service_id=16&usage%5Bhits%5D=1&user_key=e9739231309c39d91db6695015b30214 HTTP/1.1
INFO Nov 06 19:25:12 [1740]: No upstream proxy for 172.30.90.138
CONNECT Nov 06 19:25:12 [1740]: Established connection to host "172.30.90.138" using file descriptor 7.
INFO Nov 06 19:25:12 [1740]: Closed connection between local client (fd:6) and remote client (fd:7)
CONNECT Nov 06 19:25:12 [1742]: Connect (file descriptor 6): gateway [10.0.1.1]
CONNECT Nov 06 19:25:12 [1742]: Request (file descriptor 6): CONNECT 52.55.200.58:443 HTTP/1.1
INFO Nov 06 19:25:12 [1742]: No upstream proxy for 52.55.200.58
CONNECT Nov 06 19:25:12 [1742]: Established connection to host "52.55.200.58" using file descriptor 7.
INFO Nov 06 19:25:12 [1742]: Not sending client headers to remote machine
INFO Nov 06 19:26:13 [1742]: Closed connection between local client (fd:6) and remote client (fd:7)
---
3. Failure - 'apicast-staging' debug logs:
Nov 6 22:23:50 dnsmasq[12]: started, version 2.76 cachesize 1000
Nov 6 22:23:50 dnsmasq[12]: compile time options: IPv6 GNU-getopt DBus no-i18n IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth no-DNSSEC loop-detect inotify
Nov 6 22:23:50 dnsmasq[12]: using nameserver 12
#0
Nov 6 22:23:50 dnsmasq[12]: reading /etc/resolv.conf
Nov 6 22:23:50 dnsmasq[12]: using nameserver options#0
Nov 6 22:23:50 dnsmasq[12]: using nameserver 10.0.1.3#53
Nov 6 22:23:50 dnsmasq[12]: cleared cache
2019/11/06 22:23:51 [notice] 20#20: using the "epoll" event method
2019/11/06 22:23:51 [notice] 20#20: openresty/1.13.6.2
2019/11/06 22:23:51 [notice] 20#20: built by gcc 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)
2019/11/06 22:23:51 [notice] 20#20: OS: Linux 3.10.0-957.27.2.el7.x86_64
2019/11/06 22:23:51 [notice] 20#20: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_VALIDATE_POLICY_CONFIGS = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: TEST_NGINX_BINARY = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: OPENSSL_VERIFY = false
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_POLICY_LOAD_PATH = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_DIR = /opt/app-root/src
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_BUILTIN_POLICY_LOAD_PATH = /opt/app-root/src/src/apicast/policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/apicast/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/apicast/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: apicast
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/apicast/apicast.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: apicast file: /opt/app-root/src/src/apicast/policy/apicast/apicast.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.balancer
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.balancer error:
no file '/opt/app-root/src/src/apicast/policy/apicast/apicast/balancer.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.balancer
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.user_agent
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.user_agent error:
no file '/opt/app-root/src/src/apicast/policy/apicast/apicast/user_agent.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.user_agent
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.version
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: load_configuration version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/load_configuration/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/load_configuration/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: load_configuration
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/load_configuration/load_configuration.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: load_configuration file: /opt/app-root/src/src/apicast/policy/load_configuration/load_configuration.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: ngx.ssl
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: ngx.ssl error:
no file '/opt/app-root/src/policies/load_configuration/builtin/ngx/ssl.lua'
no file '/opt/app-root/src/src/apicast/policy/load_configuration/ngx/ssl.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: ngx.ssl
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_loader
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.configuration_loader error:
no file '/opt/app-root/src/policies/load_configuration/builtin/apicast/configuration_loader.lua'
no file '/opt/app-root/src/src/apicast/policy/load_configuration/apicast/configuration_loader.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.configuration_loader
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_PATH_ROUTING = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_PATH_ROUTING_ENABLED = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: all_proxy = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: ALL_PROXY = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: http_proxy = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: HTTP_PROXY = http://10.0.1.252:8888
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: https_proxy = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: HTTPS_PROXY = http://10.0.1.252:8888
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: no_proxy = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: NO_PROXY = .cluster.local,.svc,127.0.0.1,localhost,system-master,172.30.13.232
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: BACKEND_ENDPOINT_OVERRIDE = http://backend-listener:3000
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] evp.lua:142: openssl11=true err=nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: PWD = /opt/app-root
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_OIDC_LOG_LEVEL = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION_LOADER = lazy
2019/11/06 22:23:51 [info] 20#20: *2 [lua] configuration_loader.lua:240: new(): using lazy configuration loader, context: ngx.timer
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_store
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: find_service version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/find_service/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/find_service/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: find_service
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/find_service/find_service.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: find_service file: /opt/app-root/src/src/apicast/policy/find_service/find_service.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_store
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.find_service.host_based_finder
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.find_service.host_based_finder error:
no file '/opt/app-root/src/policies/find_service/builtin/apicast/policy/find_service/host_based_finder.lua'
no file '/opt/app-root/src/src/apicast/policy/find_service/apicast/policy/find_service/host_based_finder.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.find_service.host_based_finder
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.find_service.path_based_finder
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.find_service.path_based_finder error:
no file '/opt/app-root/src/policies/find_service/builtin/apicast/policy/find_service/path_based_finder.lua'
no file '/opt/app-root/src/src/apicast/policy/find_service/apicast/policy/find_service/path_based_finder.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.find_service.path_based_finder
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: local_chain version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/local_chain/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/local_chain/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: local_chain
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/local_chain/local_chain.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: local_chain file: /opt/app-root/src/src/apicast/policy/local_chain/local_chain.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: resty.env
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.proxy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.proxy error:
no file '/opt/app-root/src/policies/local_chain/builtin/apicast/proxy.lua'
no file '/opt/app-root/src/src/apicast/policy/local_chain/apicast/proxy.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.proxy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_CUSTOM_CONFIG = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_RESPONSE_CODES = true
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_REPORTING_THREADS = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.linked_list
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_MODULE = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy_chain
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] policy_loader.lua:150: loading policy: nginx_metrics version: builtin
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/nginx_metrics/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/nginx_metrics/init.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: loader(): sandbox require: nginx_metrics
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/nginx_metrics/nginx_metrics.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:100: loader(): sandboxed require for: nginx_metrics file: /opt/app-root/src/src/apicast/policy/nginx_metrics/nginx_metrics.lua
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: resty.env
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: ngx.errlog
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.prometheus
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.metrics.updater
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.metrics.updater error:
no file '/opt/app-root/src/policies/nginx_metrics/builtin/apicast/metrics/updater.lua'
no file '/opt/app-root/src/src/apicast/policy/nginx_metrics/apicast/metrics/updater.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.metrics.updater
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:84: require(): sandbox require: apicast.metrics.upstream
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:106: require(): fallback loader for: apicast.metrics.upstream error:
no file '/opt/app-root/src/policies/nginx_metrics/builtin/apicast/metrics/upstream.lua'
no file '/opt/app-root/src/src/apicast/policy/nginx_metrics/apicast/metrics/upstream.lua'
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] sandbox.lua:42: fallback(): native require for: apicast.metrics.upstream
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: NGINX_METRICS_MAX_LOGS = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:116: parse_nameservers(): /etc/resolv.conf:
nameserver 10.0.1.3
search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
options ndots:5
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: RESOLVER = 127.0.0.1:5353
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:137: parse_nameservers(): search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:141: parse_nameservers(): search domain: 3scale-25.svc.cluster.local
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:141: parse_nameservers(): search domain: svc.cluster.local
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:141: parse_nameservers(): search domain: cluster.local
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] resolver.lua:141: parse_nameservers(): search domain: ocp3-11.cluster
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:162: init_nameservers(): adding 127.0.0.1:5353 as default nameserver, context: ngx.timer
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:162: init_nameservers(): adding 10.0.1.3:53 as default nameserver, context: ngx.timer
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:167: init_nameservers(): adding 3scale-25.svc.cluster.local as search domain, context: ngx.timer
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:167: init_nameservers(): adding svc.cluster.local as search domain, context: ngx.timer
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:167: init_nameservers(): adding cluster.local as search domain, context: ngx.timer
2019/11/06 22:23:51 [info] 20#20: *2 [lua] resolver.lua:167: init_nameservers(): adding ocp3-11.cluster as search domain, context: ngx.timer
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: THREESCALE_DEPLOYMENT_ENV = staging
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_LOADED_ENVIRONMENTS = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_ENVIRONMENT = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_WORKERS = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION_CACHE = 0
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_LOG_LEVEL = debug
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_LOG_FILE = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_ACCESS_LOG_FILE = nil
2019/11/06 22:23:51 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_OPENRESTY_BINARY = nil
2019/11/06 22:23:52 [notice] 20#20: signal 17 (SIGCHLD) received from 21
2019/11/06 22:23:52 [info] 20#20: waitpid() failed (10: No child processes)
2019/11/06 22:23:52 [notice] 20#20: signal 17 (SIGCHLD) received from 23
2019/11/06 22:23:52 [info] 20#20: waitpid() failed (10: No child processes)
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: SSL_CERT_FILE = nil
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: OPENTRACING_TRACER = nil
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] filesystem.lua:25: ldir(): error listing directory: /usr/local/openresty/nginx/client_body_temp err: /usr/local/share/lua/5.1/lfs.lua:513: cannot open /usr/local/openresty/nginx/client_body_temp : Permission denied
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] filesystem.lua:25: ldir(): error listing directory: /usr/local/openresty/nginx/fastcgi_temp err: /usr/local/share/lua/5.1/lfs.lua:513: cannot open /usr/local/openresty/nginx/fastcgi_temp : Permission denied
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] filesystem.lua:25: ldir(): error listing directory: /usr/local/openresty/nginx/proxy_temp err: /usr/local/share/lua/5.1/lfs.lua:513: cannot open /usr/local/openresty/nginx/proxy_temp : Permission denied
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] filesystem.lua:25: ldir(): error listing directory: /usr/local/openresty/nginx/scgi_temp err: /usr/local/share/lua/5.1/lfs.lua:513: cannot open /usr/local/openresty/nginx/scgi_temp : Permission denied
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] filesystem.lua:25: ldir(): error listing directory: /usr/local/openresty/nginx/uwsgi_temp err: /usr/local/share/lua/5.1/lfs.lua:513: cannot open /usr/local/openresty/nginx/uwsgi_temp : Permission denied
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: OPENTRACING_FORWARD_HEADER = nil
2019/11/06 22:23:52 [debug] 20#20: *2 [lua] env.lua:86: fetch(): env: APICAST_PROXY_HTTPS_CERTIFICATE = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_DIR = /opt/app-root/src
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: THREESCALE_DEPLOYMENT_ENV = staging
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8080_TCP_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_SERVICE_HOST = 172.30.131.238
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_RESPONSE_CODES = true
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_SERVICE_PORT_MANAGEMENT = 8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_POLICY_LOAD_PATH = /opt/app-root/src/policies
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_SERVICE_HOST = 172.30.152.184
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: THREESCALE_PORTAL_ENDPOINT = http://3lin4p8t@system-master:3000/master/api/proxy/configs
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_SERVICE_PORT_GATEWAY = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT = tcp://172.30.152.184:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8080_TCP_PROTO = tcp
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8080_TCP_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8090_TCP = tcp://172.30.245.202:8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_LOG_LEVEL = debug
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_SERVICE_PORT_MANAGEMENT = 8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8090_TCP_PORT = 8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8080_TCP = tcp://172.30.245.202:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8090_TCP_PORT = 8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_LOADED_ENVIRONMENTS = /opt/app-root/src/config/staging.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT = tcp://172.30.245.202:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8080_TCP_ADDR = 172.30.245.202
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8080_TCP = tcp://172.30.152.184:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8080_TCP_PROTO = tcp
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_PORT_8080_TCP_ADDR = 172.30.131.238
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_PORT_8080_TCP_PROTO = tcp
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION_CACHE = 0
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_SERVICE_PORT_HTTP = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8090_TCP_ADDR = 172.30.152.184
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_SERVICE_PORT_GATEWAY = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8080_TCP_ADDR = 172.30.152.184
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_PORT = tcp://172.30.131.238:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_SERVICE_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8090_TCP = tcp://172.30.152.184:8090
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8090_TCP_PROTO = tcp
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_BUILTIN_POLICY_LOAD_PATH = /opt/app-root/src/src/apicast/policy
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_PORT_8080_TCP = tcp://172.30.131.238:8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_SERVICE_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_PORT_8090_TCP_PROTO = tcp
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_PORT_8090_TCP_ADDR = 172.30.245.202
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION_LOADER = lazy
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PRODUCTION_SERVICE_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_WILDCARD_ROUTER_PORT_8080_TCP_PORT = 8080
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_MANAGEMENT_API = debug
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_STAGING_SERVICE_HOST = 172.30.245.202
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:116: parse_nameservers(): /etc/resolv.conf:
nameserver 10.0.1.3
search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
options ndots:5
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: RESOLVER = 127.0.0.1:5353
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:137: parse_nameservers(): search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: 3scale-25.svc.cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: svc.cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: ocp3-11.cluster
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:162: init_nameservers(): adding 127.0.0.1:5353 as default nameserver
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:162: init_nameservers(): adding 10.0.1.3:53 as default nameserver
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding 3scale-25.svc.cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding svc.cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding ocp3-11.cluster as search domain
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_VALIDATE_POLICY_CONFIGS = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: TEST_NGINX_BINARY = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: OPENSSL_VERIFY = false
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/apicast/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/apicast/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: apicast
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/apicast/apicast.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: apicast file: /opt/app-root/src/src/apicast/policy/apicast/apicast.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.balancer
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.balancer error:
no file '/opt/app-root/src/src/apicast/policy/apicast/apicast/balancer.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.balancer
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.user_agent
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.user_agent error:
no file '/opt/app-root/src/src/apicast/policy/apicast/apicast/user_agent.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.user_agent
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.version
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: load_configuration version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/load_configuration/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/load_configuration/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: load_configuration
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/load_configuration/load_configuration.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: load_configuration file: /opt/app-root/src/src/apicast/policy/load_configuration/load_configuration.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.ssl
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: ngx.ssl error:
no file '/opt/app-root/src/policies/load_configuration/builtin/ngx/ssl.lua'
no file '/opt/app-root/src/src/apicast/policy/load_configuration/ngx/ssl.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: ngx.ssl
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_loader
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.configuration_loader error:
no file '/opt/app-root/src/policies/load_configuration/builtin/apicast/configuration_loader.lua'
no file '/opt/app-root/src/src/apicast/policy/load_configuration/apicast/configuration_loader.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.configuration_loader
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PATH_ROUTING = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_PATH_ROUTING_ENABLED = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: all_proxy = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: ALL_PROXY = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: http_proxy = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: HTTP_PROXY = http://10.0.1.252:8888
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: https_proxy = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: HTTPS_PROXY = http://10.0.1.252:8888
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: no_proxy = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: NO_PROXY = .cluster.local,.svc,127.0.0.1,localhost,system-master,172.30.13.232
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: BACKEND_ENDPOINT_OVERRIDE = http://backend-listener:3000
2019/11/06 22:23:53 [debug] 20#20: [lua] evp.lua:142: openssl11=true err=nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: PWD = /opt/app-root
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_OIDC_LOG_LEVEL = nil
2019/11/06 22:23:53 [info] 20#20: [lua] configuration_loader.lua:240: new(): using lazy configuration loader
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_store
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: find_service version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/find_service/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/find_service/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: find_service
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/find_service/find_service.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: find_service file: /opt/app-root/src/src/apicast/policy/find_service/find_service.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.configuration_store
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.find_service.host_based_finder
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.find_service.host_based_finder error:
no file '/opt/app-root/src/policies/find_service/builtin/apicast/policy/find_service/host_based_finder.lua'
no file '/opt/app-root/src/src/apicast/policy/find_service/apicast/policy/find_service/host_based_finder.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.find_service.host_based_finder
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.find_service.path_based_finder
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.find_service.path_based_finder error:
no file '/opt/app-root/src/policies/find_service/builtin/apicast/policy/find_service/path_based_finder.lua'
no file '/opt/app-root/src/src/apicast/policy/find_service/apicast/policy/find_service/path_based_finder.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.find_service.path_based_finder
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: local_chain version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/local_chain/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/local_chain/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: local_chain
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/local_chain/local_chain.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: local_chain file: /opt/app-root/src/src/apicast/policy/local_chain/local_chain.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.env
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.proxy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.proxy error:
no file '/opt/app-root/src/policies/local_chain/builtin/apicast/proxy.lua'
no file '/opt/app-root/src/src/apicast/policy/local_chain/apicast/proxy.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.proxy
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_CUSTOM_CONFIG = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_REPORTING_THREADS = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.linked_list
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: APICAST_MODULE = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy_chain
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: nginx_metrics version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/nginx_metrics/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/nginx_metrics/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: nginx_metrics
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/nginx_metrics/nginx_metrics.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: nginx_metrics file: /opt/app-root/src/src/apicast/policy/nginx_metrics/nginx_metrics.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.env
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.errlog
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.prometheus
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.metrics.updater
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.metrics.updater error:
no file '/opt/app-root/src/policies/nginx_metrics/builtin/apicast/metrics/updater.lua'
no file '/opt/app-root/src/src/apicast/policy/nginx_metrics/apicast/metrics/updater.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.metrics.updater
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.metrics.upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.metrics.upstream error:
no file '/opt/app-root/src/policies/nginx_metrics/builtin/apicast/metrics/upstream.lua'
no file '/opt/app-root/src/src/apicast/policy/nginx_metrics/apicast/metrics/upstream.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.metrics.upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: NGINX_METRICS_MAX_LOGS = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:116: parse_nameservers(): /etc/resolv.conf:
nameserver 10.0.1.3
search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
options ndots:5
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:137: parse_nameservers(): search 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: 3scale-25.svc.cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: svc.cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: cluster.local
2019/11/06 22:23:53 [debug] 20#20: [lua] resolver.lua:141: parse_nameservers(): search domain: ocp3-11.cluster
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:162: init_nameservers(): adding 127.0.0.1:5353 as default nameserver
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:162: init_nameservers(): adding 10.0.1.3:53 as default nameserver
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding 3scale-25.svc.cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding svc.cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding cluster.local as search domain
2019/11/06 22:23:53 [info] 20#20: [lua] resolver.lua:167: init_nameservers(): adding ocp3-11.cluster as search domain
2019/11/06 22:23:53 [notice] 20#20: [lua] environment.lua:195: add(): loading environment configuration: /opt/app-root/src/config/staging.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: load_configuration version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: find_service version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: local_chain version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: nginx_metrics version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] executor.lua:25: init(): executor phase: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_chain.lua:189: init(): policy chain execute phase: init, policy: Load Configuration, i: 1
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_chain.lua:189: init(): policy chain execute phase: init, policy: Find Service Policy, i: 2
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_chain.lua:189: init(): policy chain execute phase: init, policy: Local Policy Chain, i: 3
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_chain.lua:189: policy chain execute phase: init, policy: APIcast, i: 1
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_chain.lua:189: init(): policy chain execute phase: init, policy: Metrics, i: 4
2019/11/06 22:23:53 [debug] 20#20: [lua] env.lua:86: fetch(): env: NGINX_METRICS_LOG_LEVEL = nil
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: token_introspection version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/token_introspection/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/token_introspection/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: token_introspection
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/token_introspection/token_introspection.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: token_introspection file: /opt/app-root/src/src/apicast/policy/token_introspection/token_introspection.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: cjson.safe
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.http_authorization
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.http_ng
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.user_agent
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.env
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.url
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: tokens_cache
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/token_introspection/tokens_cache.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: tokens_cache file: /opt/app-root/src/src/apicast/policy/token_introspection/tokens_cache.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.lrucache
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: conditional version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/conditional/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/conditional/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: conditional
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/conditional/conditional.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: conditional file: /opt/app-root/src/src/apicast/policy/conditional/conditional.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy_chain
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.conditions.condition
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.conditions.condition error:
no file '/opt/app-root/src/src/apicast/policy/conditional/apicast/conditions/condition.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.conditions.condition
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.conditions.operation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.conditions.operation error:
no file '/opt/app-root/src/src/apicast/policy/conditional/apicast/conditions/operation.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.conditions.operation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.ngx_variable
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: upstream version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/upstream/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/upstream/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/upstream/upstream.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: upstream file: /opt/app-root/src/src/apicast/policy/upstream/upstream.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.core.base
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.balancer
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: default_credentials version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/default_credentials/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/default_credentials/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: default_credentials
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/default_credentials/default_credentials.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: default_credentials file: /opt/app-root/src/src/apicast/policy/default_credentials/default_credentials.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: rewrite_url_captures version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: rewrite_url_captures
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/rewrite_url_captures.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: rewrite_url_captures file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/rewrite_url_captures.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: named_args_matcher
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/named_args_matcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: named_args_matcher file: /opt/app-root/src/src/apicast/policy/rewrite_url_captures/named_args_matcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.re
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.query_params
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.query_params error:
no file '/opt/app-root/src/src/apicast/policy/rewrite_url_captures/apicast/query_params.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.query_params
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: logging version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/logging/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/logging/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: logging
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/logging/logging.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: logging file: /opt/app-root/src/src/apicast/policy/logging/logging.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: soap version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/soap/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/soap/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: soap
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/soap/soap.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: soap file: /opt/app-root/src/src/apicast/policy/soap/soap.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.mapping_rule
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.usage
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.mapping_rules_matcher
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.mime
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: liquid_context_debug version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: liquid_context_debug
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/liquid_context_debug.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: liquid_context_debug file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/liquid_context_debug.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: context_content
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/context_content.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: context_content file: /opt/app-root/src/src/apicast/policy/liquid_context_debug/context_content.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: cjson
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.ngx_variable
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: 3scale_batcher version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/3scale_batcher/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: 3scale_batcher
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/3scale_batcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: 3scale_batcher file: /opt/app-root/src/src/apicast/policy/3scale_batcher/3scale_batcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.backend_client
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: auths_cache
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/auths_cache.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: auths_cache file: /opt/app-root/src/src/apicast/policy/3scale_batcher/auths_cache.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.3scale_batcher.keys_helper
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.3scale_batcher.keys_helper error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/apicast/policy/3scale_batcher/keys_helper.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.3scale_batcher.keys_helper
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.re
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: reports_batcher
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/reports_batcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: reports_batcher file: /opt/app-root/src/src/apicast/policy/3scale_batcher/reports_batcher.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.3scale_batcher.keys_helper
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.lock
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.lock error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/resty/lock.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.lock
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: keys_helper
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/keys_helper.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: keys_helper file: /opt/app-root/src/src/apicast/policy/3scale_batcher/keys_helper.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.core.base
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.errors
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: reporter
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/reporter.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: reporter file: /opt/app-root/src/src/apicast/policy/3scale_batcher/reporter.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.3scale_batcher.reports_batch
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.3scale_batcher.reports_batch error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/apicast/policy/3scale_batcher/reports_batch.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.3scale_batcher.reports_batch
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.usage
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.3scale_batcher.transaction
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.3scale_batcher.transaction error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/apicast/policy/3scale_batcher/transaction.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.3scale_batcher.transaction
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: transaction
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_batcher/transaction.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: transaction file: /opt/app-root/src/src/apicast/policy/3scale_batcher/transaction.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.http_ng.backend.resty
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.semaphore
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.concurrent.timer_task
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.concurrent.timer_task error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/resty/concurrent/timer_task.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.concurrent.timer_task
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.3scale_batcher.metrics
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.3scale_batcher.metrics error:
no file '/opt/app-root/src/src/apicast/policy/3scale_batcher/apicast/policy/3scale_batcher/metrics.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.3scale_batcher.metrics
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: url_rewriting version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/url_rewriting/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/url_rewriting/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: url_rewriting
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/url_rewriting/url_rewriting.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: url_rewriting file: /opt/app-root/src/src/apicast/policy/url_rewriting/url_rewriting.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.query_params
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.template_string
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: rate_limit version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rate_limit/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/rate_limit/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: rate_limit
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rate_limit/rate_limit.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: rate_limit file: /opt/app-root/src/src/apicast/policy/rate_limit/rate_limit.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.limit.conn
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.limit.conn error:
no file '/opt/app-root/src/src/apicast/policy/rate_limit/resty/limit/conn.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.limit.conn
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.limit.req
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.limit.req error:
no file '/opt/app-root/src/src/apicast/policy/rate_limit/resty/limit/req.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.limit.req
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.limit.count-inc
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.limit.count-inc error:
no file '/opt/app-root/src/src/apicast/policy/rate_limit/resty/limit/count-inc.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.limit.count-inc
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: ngx.semaphore
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.limit.traffic
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.limit.traffic error:
no file '/opt/app-root/src/src/apicast/policy/rate_limit/resty/limit/traffic.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.limit.traffic
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: redis_shdict
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/rate_limit/redis_shdict.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: redis_shdict file: /opt/app-root/src/src/apicast/policy/rate_limit/redis_shdict.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.threescale_utils
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.conditions.condition
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.conditions.operation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.template_string
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: tls_validation version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/tls_validation/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/tls_validation/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: tls_validation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/tls_validation/tls_validation.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: tls_validation file: /opt/app-root/src/src/apicast/policy/tls_validation/tls_validation.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.openssl.x509.store
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.openssl.x509.store error:
no file '/opt/app-root/src/src/apicast/policy/tls_validation/resty/openssl/x509/store.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.openssl.x509.store
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.openssl.x509
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.openssl.x509 error:
no file '/opt/app-root/src/src/apicast/policy/tls_validation/resty/openssl/x509.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.openssl.x509
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: apicast version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: 3scale_referrer version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_referrer/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/3scale_referrer/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: 3scale_referrer
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/3scale_referrer/3scale_referrer.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: 3scale_referrer file: /opt/app-root/src/src/apicast/policy/3scale_referrer/3scale_referrer.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: keycloak_role_check version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/keycloak_role_check/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/keycloak_role_check/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: keycloak_role_check
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/keycloak_role_check/keycloak_role_check.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: keycloak_role_check file: /opt/app-root/src/src/apicast/policy/keycloak_role_check/keycloak_role_check.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.mapping_rule
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.template_string
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.errors
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: caching version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/caching/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/caching/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: caching
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/caching/caching.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: caching file: /opt/app-root/src/src/apicast/policy/caching/caching.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: echo version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/echo/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/echo/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: echo
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/echo/echo.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: echo file: /opt/app-root/src/src/apicast/policy/echo/echo.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: cjson
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: headers version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/headers/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/headers/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: headers
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/headers/headers.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: headers file: /opt/app-root/src/src/apicast/policy/headers/headers.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.template_string
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: routing version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/routing/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/routing/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: routing
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/routing/routing.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: routing file: /opt/app-root/src/src/apicast/policy/routing/routing.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.core.base
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.balancer
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: upstream_selector
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/routing/upstream_selector.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: upstream_selector file: /opt/app-root/src/src/apicast/policy/routing/upstream_selector.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: request
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/routing/request.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: request file: /opt/app-root/src/src/apicast/policy/routing/request.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: rule
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/routing/rule.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: require(): sandboxed require for: rule file: /opt/app-root/src/src/apicast/policy/routing/rule.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.core.base
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.routing.routing_operation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.routing.routing_operation error:
no file '/opt/app-root/src/src/apicast/policy/routing/apicast/policy/routing/routing_operation.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.routing.routing_operation
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.conditions.condition
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.upstream
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: ip_check version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/ip_check/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/ip_check/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: ip_check
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/ip_check/ip_check.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: ip_check file: /opt/app-root/src/src/apicast/policy/ip_check/ip_check.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: resty.iputils
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: resty.iputils error:
no file '/opt/app-root/src/src/apicast/policy/ip_check/resty/iputils.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: resty.iputils
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy.ip_check.client_ip
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:106: require(): fallback loader for: apicast.policy.ip_check.client_ip error:
no file '/opt/app-root/src/src/apicast/policy/ip_check/apicast/policy/ip_check/client_ip.lua'
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:42: fallback(): native require for: apicast.policy.ip_check.client_ip
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [debug] 20#20: [lua] policy_loader.lua:150: call(): loading policy: cors version: builtin
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/cors/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: init file: /opt/app-root/src/src/apicast/policy/cors/init.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: loader(): sandbox require: cors
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:242: loading file: /opt/app-root/src/src/apicast/policy/cors/cors.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:100: loader(): sandboxed require for: cors file: /opt/app-root/src/src/apicast/policy/cors/cors.lua
2019/11/06 22:23:53 [debug] 20#20: [lua] sandbox.lua:84: require(): sandbox require: apicast.policy
2019/11/06 22:23:53 [notice] 20#20: using the "epoll" event method
2019/11/06 22:23:53 [notice] 20#20: openresty/1.13.6.2
2019/11/06 22:23:53 [notice] 20#20: built by gcc 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)
2019/11/06 22:23:53 [notice] 20#20: OS: Linux 3.10.0-957.27.2.el7.x86_64
2019/11/06 22:23:53 [notice] 20#20: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2019/11/06 22:23:53 [notice] 20#20: start worker processes
2019/11/06 22:23:53 [notice] 20#20: start worker process 25
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] executor.lua:25: init_worker(): executor phase: init_worker
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] policy_chain.lua:189: init_worker(): policy chain execute phase: init_worker, policy: Load Configuration, i: 1
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] policy_chain.lua:189: init_worker(): policy chain execute phase: init_worker, policy: Find Service Policy, i: 2
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] policy_chain.lua:189: init_worker(): policy chain execute phase: init_worker, policy: Local Policy Chain, i: 3
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] policy_chain.lua:189: policy chain execute phase: init_worker, policy: APIcast, i: 1
2019/11/06 22:23:53 [debug] 25#25: *1 [lua] policy_chain.lua:189: init_worker(): policy chain execute phase: init_worker, policy: Metrics, i: 4
2019/11/06 22:23:56 [debug] 25#25: *2 [lua] policy_loader.lua:150: loading policy: load_configuration version: builtin
2019/11/06 22:23:56 [debug] 25#25: *2 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:23:56 [debug] 25#25: *2 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:06 [debug] 25#25: *3 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:16 [debug] 25#25: *4 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:20 [debug] 25#25: *5 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:26 [debug] 25#25: *6 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:36 [debug] 25#25: *7 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:46 [debug] 25#25: *8 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:50 [debug] 25#25: *9 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:24:56 [debug] 25#25: *10 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:06 [debug] 25#25: *11 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] executor.lua:25: rewrite(): executor phase: rewrite
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: rewrite(): policy chain execute phase: rewrite, policy: Load Configuration, i: 1
2019/11/06 22:25:12 [info] 25#25: *12 [lua] configuration_loader.lua:213: rewrite(): lazy loading configuration for: proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] env.lua:86: fetch(): env: APICAST_CONFIGURATION = nil
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] env.lua:86: fetch(): env: THREESCALE_CONFIG_FILE = nil
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:197: new(): resolver search domains: 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster 3scale-25.svc.cluster.local svc.cluster.local cluster.local ocp3-11.cluster
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: system-master
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:294: search_dns(): resolver query: system-master search: query: system-master.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss system-master.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: system-master.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:43: init_resolvers(): initializing 4 nameservers
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:56: init_resolvers(): nameserver 127.0.0.1:5353 initialized
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:56: init_resolvers(): nameserver 10.0.1.3:53 initialized
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:56: init_resolvers(): nameserver 127.0.0.1:5353 initialized
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:56: init_resolvers(): nameserver 10.0.1.3:53 initialized
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:68: query(): resolver query: system-master. nameserver: 127.0.0.1:5353
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:294: search_dns(): resolver query: system-master search: 3scale-25.svc.cluster.local query: system-master.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss system-master.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: system-master.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:68: query(): resolver query: system-master.3scale-25.svc.cluster.local nameserver: 127.0.0.1:5353
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:74: store(): resolver cache write system-master.3scale-25.svc.cluster.local with TLL 30
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: system-master finished with 1 answers
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for system-master finished with 1 answers
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: 172.30.13.232
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:333: lookup(): host is ip address: 172.30.13.232
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: 172.30.13.232 finished with 1 answers
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for 172.30.13.232 finished with 1 answers
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] http.lua:50: connect(): connected to ip:172.30.13.232 host: 172.30.13.232 port: 3000 ok: 1 err: nil
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] proxy.lua:26: new(): connection to system-master:3000 established, reused times: 0
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] http.lua:633: send_request():
GET /master/api/proxy/configs/staging.json?host=proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster HTTP/1.1
User-Agent: APIcast/3.5.1 (Linux; x64; env:staging) APIcast/3.5.1
Host: system-master:3000
Connection: Keep-Alive
Authorization: Basic M2xpbjRwOHQ6
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] remote_v2.lua:108: index(): index get status: 200 url: http://3lin4p8t@system-master:3000/master/api/proxy/configs/staging.json?host=proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_loader.lua:150: loading policy: apicast version: builtin
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] sandbox.lua:84: loader(): sandbox require: init
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] env.lua:86: fetch(): env: APICAST_SERVICES_LIST = nil
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] env.lua:86: fetch(): env: APICAST_SERVICES = nil
2019/11/06 22:25:12 [info] 25#25: *12 [lua] configuration_store.lua:124: store(): added service 16 configuration with hosts: proxy-test-3scale-apicast-production.3scale-25.apps.ocp3-11.cluster, proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster ttl: 0, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: rewrite(): policy chain execute phase: rewrite, policy: Find Service Policy, i: 2
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: rewrite(): policy chain execute phase: rewrite, policy: Local Policy Chain, i: 3
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] env.lua:86: fetch(): env: APICAST_BACKEND_CACHE_HANDLER = nil
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache_handler.lua:23: new(): backend cache handler: strict
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: rewrite(): policy chain execute phase: rewrite, policy: APIcast, i: 1
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] service.lua:227: get_usage(): [mapping] service 16 has 2 rules
2019/11/06 22:25:12 [warn] 25#25: *12 a client request body is buffered to a temporary file /tmp/lua_GzcbiV/client_body_temp/0000000001, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [notice] 25#25: *12 [lua] service.lua:175: get_auth_params(): Error while getting post args: request body in temp file not supported, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: rewrite(): policy chain execute phase: rewrite, policy: Metrics, i: 4
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] executor.lua:25: access(): executor phase: access
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: access(): policy chain execute phase: access, policy: Load Configuration, i: 1
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: access(): policy chain execute phase: access, policy: Find Service Policy, i: 2
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: access(): policy chain execute phase: access, policy: Local Policy Chain, i: 3
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: access, policy: APIcast, i: 1
2019/11/06 22:25:12 [info] 25#25: *12 [lua] proxy.lua:81: output_debug_headers(): usage: usage%5Bhits%5D=1 credentials: user_key=e9739231309c39d91db6695015b30214, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [info] 25#25: *12 [lua] proxy.lua:150: apicast cache miss key: 16:e9739231309c39d91db6695015b30214:usage%5Bhits%5D=1 value: nil, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: backend-listener
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:294: search_dns(): resolver query: backend-listener search: query: backend-listener.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss backend-listener.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: backend-listener.
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:68: query(): resolver query: backend-listener. nameserver: 127.0.0.1:5353
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] resolver.lua:294: search_dns(): resolver query: backend-listener search: 3scale-25.svc.cluster.local query: backend-listener.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss backend-listener.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: backend-listener.3scale-25.svc.cluster.local
2019/11/06 22:25:12 [debug] 25#25: *12 [lua] dns_client.lua:68: query(): resolver query: backend-listener.3scale-25.svc.cluster.local nameserver: 127.0.0.1:5353
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:74: store(): resolver cache write backend-listener.3scale-25.svc.cluster.local with TLL 30
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: backend-listener finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for backend-listener finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: 10.0.1.252
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:333: lookup(): host is ip address: 10.0.1.252
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: 10.0.1.252 finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for 10.0.1.252 finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] http.lua:50: connect(): connected to ip:10.0.1.252 host: 10.0.1.252 port: 8888 ok: 1 err: nil
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] proxy.lua:84: new(): connection to 10.0.1.252:8888 established, pool: 10.0.1.252:8888:backend-listener:3000 reused times: 0
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] http.lua:633: send_request():
GET http://172.30.90.138:3000/transactions/authrep.xml?service_token=dfbb0aacb2a772cccc0b03aad920c146d3637643590c013840ad5fe1019f54e5&service_id=16&usage%5Bhits%5D=1&user_key=e9739231309c39d91db6695015b30214 HTTP/1.1
User-Agent: APIcast/3.5.1 (Linux; x64; env:staging) APIcast/3.5.1
3scale-Options: rejection_reason_header=1&limit_headers=1&no_body=1
Connection: Keep-Alive
Host: backend-listener
2019/11/06 22:25:13 [info] 25#25: *12 [lua] backend_client.lua:142: call_backend_transaction(): backend client uri: http://backend-listener:3000/transactions/authrep.xml?service_token=dfbb0aacb2a772cccc0b03aad920c146d3637643590c013840ad5fe1019f54e5&service_id=16&usage%5Bhits%5D=1&user_key=e9739231309c39d91db6695015b30214 ok: true status: 200 body: error: nil, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] proxy.lua:370: handle_backend_response(): [backend] response status: 200 body:
2019/11/06 22:25:13 [info] 25#25: *12 [lua] cache_handler.lua:43: cache_handler(): apicast cache write key: 16:e9739231309c39d91db6695015b30214:usage%5Bhits%5D=1, ttl: nil, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster"
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] policy_chain.lua:189: access(): policy chain execute phase: access, policy: Metrics, i: 4
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] executor.lua:25: content(): executor phase: content
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] policy_chain.lua:189: content(): policy chain execute phase: content, policy: Load Configuration, i: 1
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] policy_chain.lua:189: content(): policy chain execute phase: content, policy: Find Service Policy, i: 2
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] policy_chain.lua:189: content(): policy chain execute phase: content, policy: Local Policy Chain, i: 3
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: content, policy: APIcast, i: 1
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] upstream.lua:185: call(): using proxy: http://10.0.1.252:8888
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: postman-echo.com
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss postman-echo.com
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: postman-echo.com
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:294: search_dns(): resolver query: postman-echo.com search: query: postman-echo.com.
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:122: fetch_answers(): resolver cache miss postman-echo.com.
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:188: get(): resolver cache miss: postman-echo.com.
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] dns_client.lua:68: query(): resolver query: postman-echo.com. nameserver: 127.0.0.1:5353
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] cache.lua:74: store(): resolver cache write postman-echo.com with TLL 59
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: postman-echo.com finished with 2 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for postman-echo.com finished with 2 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:328: lookup(): resolver query: 10.0.1.252
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:333: lookup(): host is ip address: 10.0.1.252
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:348: lookup(): resolver query: 10.0.1.252 finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] resolver.lua:388: get_servers(): query for 10.0.1.252 finished with 1 answers
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] http.lua:50: connect(): connected to ip:10.0.1.252 host: 10.0.1.252 port: 8888 ok: 1 err: nil
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] proxy.lua:84: new(): connection to 10.0.1.252:8888 established, pool: 10.0.1.252:8888:postman-echo.com:443 reused times: 0
2019/11/06 22:25:13 [debug] 25#25: *12 [lua] http.lua:633: send_request():
CONNECT 52.55.200.58:443 HTTP/1.1
User-Agent: lua-resty-http/0.12 (Lua) ngx_lua/10013
Host: postman-echo.com:443
2019/11/06 22:25:14 [debug] 25#25: *12 [lua] http.lua:633: send_request():
POST /post?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1
User-Agent: curl/7.61.1
X-Forwarded-Port: 443
Content-Type: application/x-www-form-urlencoded
X-Forwarded-Host: proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster
Host: postman-echo.com
Accept: */*
Cache-Control: no-cache
Content-Length: 12654
X-Forwarded-Proto: https
X-Forwarded-For: 10.0.1.1
Forwarded: for=10.0.1.1;host=proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster;proto=https;proto-version=
2019/11/06 22:25:16 [debug] 25#25: *20 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:20 [debug] 25#25: *21 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:26 [debug] 25#25: *22 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:36 [debug] 25#25: *23 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:46 [debug] 25#25: *24 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:50 [debug] 25#25: *25 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:25:56 [debug] 25#25: *26 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:06 [debug] 25#25: *27 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:14 [error] 25#25: *12 lua tcp socket read timed out, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "postman-echo.com"
2019/11/06 22:26:14 [error] 25#25: *12 [lua] http_proxy.lua:117: forward_https_request(): failed to proxy request to: http://10.0.1.252:8888 err : timeout, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "postman-echo.com"
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] executor.lua:25: header_filter(): executor phase: header_filter
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: header_filter(): policy chain execute phase: header_filter, policy: Load Configuration, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: header_filter(): policy chain execute phase: header_filter, policy: Find Service Policy, i: 2
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: header_filter(): policy chain execute phase: header_filter, policy: Local Policy Chain, i: 3
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: header_filter, policy: APIcast, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: header_filter(): policy chain execute phase: header_filter, policy: Metrics, i: 4
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] executor.lua:25: body_filter(): executor phase: body_filter
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: body_filter(): policy chain execute phase: body_filter, policy: Load Configuration, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: body_filter(): policy chain execute phase: body_filter, policy: Find Service Policy, i: 2
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: body_filter(): policy chain execute phase: body_filter, policy: Local Policy Chain, i: 3
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: body_filter, policy: APIcast, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: body_filter(): policy chain execute phase: body_filter, policy: Metrics, i: 4
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] executor.lua:25: post_action(): executor phase: post_action
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: post_action(): policy chain execute phase: post_action, policy: Load Configuration, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: post_action(): policy chain execute phase: post_action, policy: Find Service Policy, i: 2
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: post_action(): policy chain execute phase: post_action, policy: Local Policy Chain, i: 3
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: post_action, policy: APIcast, i: 1
2019/11/06 22:26:14 [info] 25#25: *12 [lua] proxy.lua:333: [async] skipping after action, no cached key, client: 10.128.0.1, server: _, request: "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1", host: "postman-echo.com"
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: post_action(): policy chain execute phase: post_action, policy: Metrics, i: 4
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] executor.lua:25: log(): executor phase: log
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: log(): policy chain execute phase: log, policy: Load Configuration, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: log(): policy chain execute phase: log, policy: Find Service Policy, i: 2
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: log(): policy chain execute phase: log, policy: Local Policy Chain, i: 3
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: policy chain execute phase: log, policy: APIcast, i: 1
2019/11/06 22:26:14 [debug] 25#25: *12 [lua] policy_chain.lua:189: log(): policy chain execute phase: log, policy: Metrics, i: 4
[06/Nov/2019:22:26:14 +0000] proxy-test-3scale-apicast-staging.3scale-25.apps.ocp3-11.cluster:8080 10.128.0.1:41038 "POST /?user_key=e9739231309c39d91db6695015b30214 HTTP/1.1" 502 170 (61.162) 0
2019/11/06 22:26:16 [debug] 25#25: *28 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:20 [debug] 25#25: *29 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:26 [debug] 25#25: *30 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:36 [debug] 25#25: *31 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:46 [debug] 25#25: *32 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:50 [debug] 25#25: *33 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:26:56 [debug] 25#25: *34 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:27:06 [debug] 25#25: *35 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:27:16 [debug] 25#25: *36 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:27:20 [debug] 25#25: *37 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:27:26 [debug] 25#25: *38 [lua] management.lua:177: router(): management api mode: debug
2019/11/06 22:27:36 [debug] 25#25: *39 [lua] management.lua:177: router(): management api mode: debug