Uploaded image for project: 'Red Hat 3scale API Management'
  1. Red Hat 3scale API Management
  2. THREESCALE-5642

operator crashes when default cr for backend is used

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • 2.9 GA
    • None
    • 3scale Operator
    • None
    • Not Started
    • Not Started
    • Not Started
    • Not Started
    • Not Started
    • Not Started

      I've tried to deploy new backend by CRD with default value just with different url:

      apiVersion: capabilities.3scale.net/v1beta1
      kind: Backend
      metadata:
       name: backend1
       namespace: mkudlej
      spec:
       name: Operated Backend 1
       privateBaseURL: 'http://httpbin.org/get'
       systemName: backend1
      

      and 3scale operator started to crashed in loop. Error from logs:

      {"level":"info","ts":1594734896.7856967,"logger":"cmd","msg":"Operator Version: 0.6.0"}
      {"level":"info","ts":1594734896.7862701,"logger":"cmd","msg":"Go Version: go1.13.4"}
      {"level":"info","ts":1594734896.7862792,"logger":"cmd","msg":"Go OS/Arch: linux/amd64"}
      {"level":"info","ts":1594734896.7862828,"logger":"cmd","msg":"Version of operator-sdk: v0.15.2"}
      {"level":"info","ts":1594734896.7868297,"logger":"leader","msg":"Trying to become the leader."}
      {"level":"info","ts":1594734899.4623337,"logger":"leader","msg":"Found existing lock with my name. I was likely restarted."}
      {"level":"info","ts":1594734899.4624767,"logger":"leader","msg":"Continuing as the leader."}
      {"level":"info","ts":1594734902.1201956,"logger":"controller-runtime.metrics","msg":"metrics server is starting to listen","addr":"0.0.0.0:8383"}
      {"level":"info","ts":1594734902.1206355,"logger":"cmd","msg":"Registering Components."}
      {"level":"info","ts":1594734915.4940333,"logger":"metrics","msg":"Metrics Service object updated","Service.Name":"threescale-operator-metrics","Service.Namespace":"mkudlej"}
      {"level":"info","ts":1594734920.900352,"logger":"cmd","msg":"Could not create ServiceMonitor object","error":"servicemonitors.monitoring.coreos.com \"threescale-operator-metrics\" already exists"}
      {"level":"info","ts":1594734920.9004142,"logger":"cmd","msg":"Starting the Cmd."}
      {"level":"info","ts":1594734920.900941,"logger":"controller-runtime.manager","msg":"starting metrics server","path":"/metrics"}
      {"level":"info","ts":1594734920.9010909,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"tenant-controller","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734920.901312,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"apimanager-controller","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734920.901397,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"controller_apimanagerbackup","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734920.9014876,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"controller_product","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734920.9015603,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"backend-controller","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734920.9011867,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"controller_apimanagerrestore","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734921.001784,"logger":"controller-runtime.controller","msg":"Starting Controller","controller":"tenant-controller"}
      {"level":"info","ts":1594734921.0018613,"logger":"controller-runtime.controller","msg":"Starting workers","controller":"tenant-controller","worker count":1}
      {"level":"info","ts":1594734921.001931,"logger":"controller-runtime.controller","msg":"Starting Controller","controller":"backend-controller"}
      {"level":"info","ts":1594734921.001945,"logger":"controller-runtime.controller","msg":"Starting workers","controller":"backend-controller","worker count":1}
      {"level":"info","ts":1594734921.0023782,"logger":"controller_backend","msg":"Reconcile Backend","Request.Namespace":"mkudlej","Request.Name":"backend1","Operator version":"0.6.0"}
      {"level":"info","ts":1594734921.0023654,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"apimanager-controller","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734921.0025253,"logger":"controller-runtime.controller","msg":"Starting Controller","controller":"controller_apimanagerbackup"}
      {"level":"info","ts":1594734921.0027053,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"controller_apimanagerrestore","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734921.0027566,"logger":"controller-runtime.controller","msg":"Starting Controller","controller":"controller_product"}
      {"level":"info","ts":1594734921.102904,"logger":"controller-runtime.controller","msg":"Starting workers","controller":"controller_product","worker count":1}
      {"level":"info","ts":1594734921.1028826,"logger":"controller-runtime.controller","msg":"Starting EventSource","controller":"apimanager-controller","source":"kind source: /, Kind="}
      {"level":"info","ts":1594734921.1037533,"logger":"controller-runtime.controller","msg":"Starting workers","controller":"controller_apimanagerbackup","worker count":1}
      {"level":"info","ts":1594734921.1037571,"logger":"controller_backend","msg":"LookupProviderAccount no provider account found"}
      {"level":"info","ts":1594734921.1038253,"logger":"controller-runtime.controller","msg":"Starting Controller","controller":"controller_apimanagerrestore"}
      E0714 13:55:21.103938 1 runtime.go:78] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
      goroutine 2359 [running]:
      k8s.io/apimachinery/pkg/util/runtime.logPanic(0x167c980, 0x26dd820)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/runtime/runtime.go:74 +0xa3
      k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/runtime/runtime.go:48 +0x82
      panic(0x167c980, 0x26dd820)
       /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:679 +0x1b2
      github.com/3scale/3scale-operator/pkg/helper.PortaClient(...)
       /remote-source/app/pkg/helper/threescale_api.go:92
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).reconcileSpec(0xc000514180, 0xc000134fc0, 0x2, 0x2, 0x1ae3380)
       /remote-source/app/pkg/controller/backend/backend_controller.go:191 +0x13f
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).reconcile(0xc000514180, 0xc000134fc0, 0x1aa29a0, 0x2718180, 0x7, 0xc000407f30)
       /remote-source/app/pkg/controller/backend/backend_controller.go:153 +0x2ae
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).Reconcile(0xc000514180, 0xc000407f38, 0x7, 0xc000407f30, 0x8, 0xc000cbccd8, 0xc0009e2ea0, 0xc0009e2e18, 0x1aa9c40)
       /remote-source/app/pkg/controller/backend/backend_controller.go:131 +0x421
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00017f680, 0x16d86c0, 0xc000a30f00, 0x43eb00)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:256 +0x162
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00017f680, 0x0)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:232 +0xcb
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00017f680)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:211 +0x2b
      k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000a26910)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:152 +0x5e
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a26910, 0x3b9aca00, 0x0, 0x1, 0xc0000b0480)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:153 +0xf8
      k8s.io/apimachinery/pkg/util/wait.Until(0xc000a26910, 0x3b9aca00, 0xc0000b0480)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:88 +0x4d
      created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:193 +0x328
      panic: runtime error: invalid memory address or nil pointer dereference [recovered]
       panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x149700f]
      
      goroutine 2359 [running]:
      k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/runtime/runtime.go:55 +0x105
      panic(0x167c980, 0x26dd820)
       /opt/rh/go-toolset-1.13/root/usr/lib/go-toolset-1.13-golang/src/runtime/panic.go:679 +0x1b2
      github.com/3scale/3scale-operator/pkg/helper.PortaClient(...)
       /remote-source/app/pkg/helper/threescale_api.go:92
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).reconcileSpec(0xc000514180, 0xc000134fc0, 0x2, 0x2, 0x1ae3380)
       /remote-source/app/pkg/controller/backend/backend_controller.go:191 +0x13f
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).reconcile(0xc000514180, 0xc000134fc0, 0x1aa29a0, 0x2718180, 0x7, 0xc000407f30)
       /remote-source/app/pkg/controller/backend/backend_controller.go:153 +0x2ae
      github.com/3scale/3scale-operator/pkg/controller/backend.(*ReconcileBackend).Reconcile(0xc000514180, 0xc000407f38, 0x7, 0xc000407f30, 0x8, 0xc000cbccd8, 0xc0009e2ea0, 0xc0009e2e18, 0x1aa9c40)
       /remote-source/app/pkg/controller/backend/backend_controller.go:131 +0x421
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00017f680, 0x16d86c0, 0xc000a30f00, 0x43eb00)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:256 +0x162
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00017f680, 0x0)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:232 +0xcb
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc00017f680)
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:211 +0x2b
      k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000a26910)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:152 +0x5e
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a26910, 0x3b9aca00, 0x0, 0x1, 0xc0000b0480)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:153 +0xf8
      k8s.io/apimachinery/pkg/util/wait.Until(0xc000a26910, 0x3b9aca00, 0xc0000b0480)
       /remote-source/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.0.0-20191004115801-a2eda9f80ab8/pkg/util/wait/wait.go:88 +0x4d
      created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
       /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.4.0/pkg/internal/controller/controller.go:193 +0x328
      

       

            Unassigned Unassigned
            mkudlej@redhat.com Martin Kudlej
            Eguzki Astiz Lezaun Eguzki Astiz Lezaun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: