Uploaded image for project: 'FlightPath'
  1. FlightPath
  2. FLPATH-1787

[Tracking] M2 - sonata platform index and jobs service pods clbo "Migrations have failed validation"

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Important

      Description of the problem:

      One of the two pods of the sonata platform index and jobs service pods are clbo after M2 operator deployment: 

       

      NAME                                                      READY   STATUS             RESTARTS          AGE
      sonataflow-platform-data-index-service-7d459cf464-ch97n   0/1     CrashLoopBackOff   118 (89s ago)     11h
      sonataflow-platform-data-index-service-8568dd769b-xwp56   1/1     Running            0                 12h
      sonataflow-platform-jobs-service-55d79cc7f7-q84sh         0/1     CrashLoopBackOff   147 (4m28s ago)   12h
      sonataflow-platform-jobs-service-b9b4dc6f5-vhh2b          1/1     Running            0                 12h
      sonataflow-psql-postgresql-0                              1/1     Running            0                 12h
       

      Does not occur with M3

       

      Version Info:

      • quay.io/orchestrator/orchestrator-operator-catalog:v1.2.0 
      • OCP 4.15
      • oc get csv
        NAME                           DISPLAY                               VERSION   REPLACES                       PHASE
        logic-operator-rhel8.v1.34.0   OpenShift Serverless Logic Operator   1.34.0    logic-operator-rhel8.v1.33.0   Succeeded
        orchestrator-operator.v1.2.0   Orchestrator Operator                 1.2.0                                    Succeeded
        rhdh-operator.v1.2.4           Red Hat Developer Hub Operator        1.2.4     rhdh-operator.v1.1.1           Succeeded
        serverless-operator.v1.34.0    Red Hat OpenShift Serverless          1.34.0    serverless-operator.v1.33.0    Succeeded 

      How reproducible:

      100%

      Steps to reproduce:

      1. Deploy the Orchestrator using the 1.2.0 quay catalog source

      2. Create orchestrator resource

      3. Monitor for deployment success

      Actual results:

      oc logs -f sonataflow-platform-data-index-service-7d459cf464-qk5z8:

      __  ____  __  _____   ___  __ ____  ______
       --/ __ \/ / / / _ | / _ \/ //_/ / / / __/
       -/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
      --\___\_\____/_/ |_/_/|_/_/|_|\____/___/
      2024-10-22 14:09:03,889 WARN  [io.qua.config] (main) Unrecognized configuration key "quarkus.kogito.devservices.enabled" was provided; it will be ignored; verify that the dependency extension for this configuration is set or that you did not make a typo
      2024-10-22 14:09:25,885 WARN  [io.qua.run.con.ConfigRecorder] (main) Build time property cannot be changed at runtime:
       - quarkus.devservices.enabled is set to 'false' but it is build time fixed to 'true'. Did you change the property quarkus.devservices.enabled after building the application?
      2024-10-22 14:09:34,784 INFO  [org.fly.cor.int.lic.VersionPrinter] (main) Flyway Community Edition 9.22.3 by Redgate
      2024-10-22 14:09:34,784 INFO  [org.fly.cor.int.lic.VersionPrinter] (main) See release notes here: https://rd.gt/416ObMi
      2024-10-22 14:09:34,784 INFO  [org.fly.cor.int.lic.VersionPrinter] (main)
      2024-10-22 14:09:35,083 INFO  [org.fly.cor.FlywayExecutor] (main) Database: jdbc:postgresql://sonataflow-psql-postgresql.sonataflow-infra:5432/sonataflow (PostgreSQL 15.4)
      2024-10-22 14:09:36,583 ERROR [io.qua.run.Application] (main) Failed to start application (with profile [http-events-support]): java.lang.RuntimeException: Failed to start quarkus
              at io.quarkus.runner.ApplicationImpl.doStart(Unknown Source)
              at io.quarkus.runtime.Application.start(Application.java:101)
              at io.quarkus.runtime.ApplicationLifecycleManager.run(ApplicationLifecycleManager.java:111)
              at io.quarkus.runtime.Quarkus.run(Quarkus.java:71)
              at io.quarkus.runtime.Quarkus.run(Quarkus.java:44)
              at io.quarkus.runtime.Quarkus.run(Quarkus.java:124)
              at io.quarkus.runner.GeneratedMain.main(Unknown Source)
              at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
              at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.base/java.lang.reflect.Method.invoke(Method.java:569)
              at io.quarkus.bootstrap.runner.QuarkusEntryPoint.doRun(QuarkusEntryPoint.java:62)
              at io.quarkus.bootstrap.runner.QuarkusEntryPoint.main(QuarkusEntryPoint.java:33)
      Caused by: org.flywaydb.core.api.exception.FlywayValidateException: Validate failed: Migrations have failed validation
      Migration checksum mismatch for migration version 1.32.0
      -> Applied to database : 1722286283
      -> Resolved locally    : -1617474746
      Either revert the changes to the migration, or run repair to update the schema history.
      Migration checksum mismatch for migration version 1.44.0
      -> Applied to database : 799676352
      -> Resolved locally    : -238684566
      Either revert the changes to the migration, or run repair to update the schema history.
      Migration checksum mismatch for migration version 1.45.0.0
      -> Applied to database : 1929821678
      -> Resolved locally    : 2057259052
      Either revert the changes to the migration, or run repair to update the schema history.
      Migration checksum mismatch for migration version 1.45.0.1
      -> Applied to database : 1858786130
      -> Resolved locally    : 1038959302
      Either revert the changes to the migration, or run repair to update the schema history.
      Migration checksum mismatch for migration version 1.45.0.2
      -> Applied to database : 1108215354
      -> Resolved locally    : 476481841
      Either revert the changes to the migration, or run repair to update the schema history.
      Migration checksum mismatch for migration version 1.45.0.3
      -> Applied to database : 1740979619
      -> Resolved locally    : -1303498017
      Either revert the changes to the migration, or run repair to update the schema history.
      Detected resolved migration not applied to database: 1.5.0.
      To ignore this migration, set -ignoreMigrationPatterns='*:ignored'. To allow executing this migration, set -outOfOrder=true.
      Need more flexibility with validation rules? Learn more: https://rd.gt/3AbJUZE
              at org.flywaydb.core.Flyway.lambda$migrate$0(Flyway.java:146)
              at org.flywaydb.core.FlywayExecutor.execute(FlywayExecutor.java:213)
              at org.flywaydb.core.Flyway.migrate(Flyway.java:140)
              at io.quarkus.flyway.runtime.FlywayRecorder.doStartActions(FlywayRecorder.java:136)
              at io.quarkus.deployment.steps.FlywayProcessor$startActions2099152139.deploy_0(Unknown Source)
              at io.quarkus.deployment.steps.FlywayProcessor$startActions2099152139.deploy(Unknown Source)
              ... 13 more 

       

       oc logs sonataflow-platform-jobs-service-55d79cc7f7-qtxrg:

      __  ____  __  _____   ___  __ ____  ______
       --/ __ \/ / / / _ | / _ \/ //_/ / / / __/
       -/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
      --\___\_\____/_/ |_/_/|_/_/|_|\____/___/
      2024-10-22 14:14:00,352 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg WARN  [io.quarkus.config:-1] (main) Unrecognized configuration key "quarkus.kogito.devservices.enabled" was provided; it will be ignored; verify that the dependency extension for this configuration is set or that you did not make a typo
      2024-10-22 14:14:04,158 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg WARN  [io.quarkus.runtime.configuration.ConfigRecorder:-1] (main) Build time property cannot be changed at runtime:
       - quarkus.devservices.enabled is set to 'false' but it is build time fixed to 'true'. Did you change the property quarkus.devservices.enabled after building the application?
      2024-10-22 14:14:08,054 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg INFO  [org.flywaydb.core.internal.license.VersionPrinter:37] (main) Flyway Community Edition 9.22.3 by Redgate
      2024-10-22 14:14:08,057 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg INFO  [org.flywaydb.core.internal.license.VersionPrinter:37] (main) See release notes here: https://rd.gt/416ObMi
      2024-10-22 14:14:08,057 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg INFO  [org.flywaydb.core.internal.license.VersionPrinter:37] (main)
      2024-10-22 14:14:08,157 sonataflow-platform-jobs-service-55d79cc7f7-qtxrg INFO  [org.flywaydb.core.FlywayExecutor:37] (main) Database: jdbc:postgresql://sonataflow-psql-postgresql.sonataflow-infra:5432/sonataflow (PostgreSQL 15.4)
      [root@sealusa12 ~]#
       

      Orchestrator resource says install was successful

       oc get orchestrator -A
      NAMESPACE      NAME           READY   REASON
      orchestrator   orchestrator   True    InstallSuccessful
       

       

      Expected results:

      No pods in error state

              chadcrum Chad Crum
              chadcrum Chad Crum
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: