Uploaded image for project: 'Kogito'
  1. Kogito
  2. KOGITO-4729

Upgrade from Operator 1.3.0 to 1.4.0 fails with reference to Kafka Topics

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 1.6.0.Final
    • 1.4.0.Final
    • Operator
    • False
    • False
    • Undefined
    • 2021 Week 13-15 (from Mar 29)

      The AWS dev cluster is attempting an update to Kogito Operator 1.4.0 from 1.3.0 and is failing with the following error seen in the Operator logs:

      E0319 11:46:33.837847       1 runtime.go:78] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
      goroutine 560 [running]:
      k8s.io/apimachinery/pkg/util/runtime.logPanic(0x18bcd40, 0x2be2750)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/runtime/runtime.go:74 +0xa3
      k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/runtime/runtime.go:48 +0x82
      panic(0x18bcd40, 0x2be2750)
      	/usr/local/go/src/runtime/panic.go:969 +0x166
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*kafkaMessagingDeployer).createRequiredKafkaTopics(0xc00ead78c0, 0x1e52480, 0xc00f0ab2c0, 0x7f46c260a3c0, 0xc00ee0cb00, 0xc00f0ab2c0, 0x0)
      	/workspace/core/kogitoservice/messaging_kafka.go:42 +0xd3
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*kafkaMessagingDeployer).CreateRequiredResources(0xc00ead78c0, 0x7f46c260a3c0, 0xc00ee0cb00, 0x1ae2ce9, 0x6)
      	/workspace/core/kogitoservice/messaging_kafka.go:34 +0xaf
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*serviceDeployer).configureMessaging(0xc00f0a2000, 0x0, 0x0)
      	/workspace/core/kogitoservice/deployer.go:235 +0xfe
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*serviceDeployer).Deploy(0xc00f0a2000, 0x0, 0x0, 0x0)
      	/workspace/core/kogitoservice/deployer.go:183 +0xf82
      github.com/kiegroup/kogito-cloud-operator/controllers.(*KogitoRuntimeReconciler).Reconcile(0xc000a93de0, 0xc0009f4010, 0x10, 0xc000615f84, 0x5, 0xc00ee24900, 0xc000993c20, 0xc000688408, 0xc0006883f0)
      	/workspace/controllers/kogitoruntime_controller.go:113 +0x76a
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a86750, 0x192ac80, 0xc00098a0a0, 0x0)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:244 +0x284
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a86750, 0xc00ee0a600)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218 +0xae
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc000a86750)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197 +0x2b
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0073b2fb0)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:155 +0x5f
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0073b2fb0, 0x1dda900, 0xc00e22ed80, 0x1, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:156 +0xa3
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0073b2fb0, 0x3b9aca00, 0x0, 0x1, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:133 +0x98
      k8s.io/apimachinery/pkg/util/wait.Until(0xc0073b2fb0, 0x3b9aca00, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:90 +0x4d
      created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:179 +0x42d
      panic: runtime error: invalid memory address or nil pointer dereference [recovered]
      	panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1712103]
      
      goroutine 560 [running]:
      k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/runtime/runtime.go:55 +0x105
      panic(0x18bcd40, 0x2be2750)
      	/usr/local/go/src/runtime/panic.go:969 +0x166
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*kafkaMessagingDeployer).createRequiredKafkaTopics(0xc00ead78c0, 0x1e52480, 0xc00f0ab2c0, 0x7f46c260a3c0, 0xc00ee0cb00, 0xc00f0ab2c0, 0x0)
      	/workspace/core/kogitoservice/messaging_kafka.go:42 +0xd3
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*kafkaMessagingDeployer).CreateRequiredResources(0xc00ead78c0, 0x7f46c260a3c0, 0xc00ee0cb00, 0x1ae2ce9, 0x6)
      	/workspace/core/kogitoservice/messaging_kafka.go:34 +0xaf
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*serviceDeployer).configureMessaging(0xc00f0a2000, 0x0, 0x0)
      	/workspace/core/kogitoservice/deployer.go:235 +0xfe
      github.com/kiegroup/kogito-cloud-operator/core/kogitoservice.(*serviceDeployer).Deploy(0xc00f0a2000, 0x0, 0x0, 0x0)
      	/workspace/core/kogitoservice/deployer.go:183 +0xf82
      github.com/kiegroup/kogito-cloud-operator/controllers.(*KogitoRuntimeReconciler).Reconcile(0xc000a93de0, 0xc0009f4010, 0x10, 0xc000615f84, 0x5, 0xc00ee24900, 0xc000993c20, 0xc000688408, 0xc0006883f0)
      	/workspace/controllers/kogitoruntime_controller.go:113 +0x76a
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a86750, 0x192ac80, 0xc00098a0a0, 0x0)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:244 +0x284
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a86750, 0xc00ee0a600)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218 +0xae
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker(0xc000a86750)
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197 +0x2b
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0073b2fb0)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:155 +0x5f
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0073b2fb0, 0x1dda900, 0xc00e22ed80, 0x1, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:156 +0xa3
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0073b2fb0, 0x3b9aca00, 0x0, 0x1, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:133 +0x98
      k8s.io/apimachinery/pkg/util/wait.Until(0xc0073b2fb0, 0x3b9aca00, 0xc000048840)
      	/go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:90 +0x4d
      created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
      	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:179 +0x42d 

      I have attached the full log of the Operator to this issue.

      As the error seems to relate to Kafka, I can confirm that Strimzi 0.21.1 is installed from the stable channel. There appears to be a single instance of the Kafka CRD running in the cluster. I have attached the CR for that instance to this issue.

       

       

        1. kafka-my-cluster.yaml
          4 kB
          Rob Blake
        2. kogito-operator-1.4-log.txt
          134 kB
          Rob Blake

              vajain Vaibhav Jain
              rblake@redhat.com Rob Blake
              Karel Suta Karel Suta
              Karel Suta Karel Suta
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: