Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4874

Oracle connector Nullpointer exception

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • None
    • None
    • oracle-connector
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      Oracle version: Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production

       

      Configuration:

       

      {    "name""apptest1-xstream-connector-2",    "config": {                "connector.class""io.debezium.connector.oracle.OracleConnector",                "tasks.max""1",                "database.history.kafka.topic""test1_spli-debezium_app_schema-changes",                "transforms.MYAPP_SURVEY_QUESTION.type""org.apache.kafka.connect.transforms.RegexRouter",                "transforms""MYAPP_SURVEY_COMPL,MYAPP_SURVEY_QUESTION,MYAPP_SURVEY_RESPONSE",                "database.tablename.case.insensitive""true",                "transforms.MYAPP_SURVEY_QUESTION.regex"".*MYAPP.MYAPP_SURVEY_QUESTION",                "decimal.handling.mode""double",                "internal.database.oracle.version""11",                "transforms.MYAPP_SURVEY_COMPL.type""org.apache.kafka.connect.transforms.RegexRouter",                "transforms.MYAPP_SURVEY_COMPL.regex"".*MYAPP.MYAPP_SURVEY_COMPL",                "database.history.skip.unparseable.ddl""true",                "database.out.server.name""OUTBOUND_SERVER",                "value.converter""org.apache.kafka.connect.json.JsonConverter",                "database.oracle.version""11",                "key.converter""org.apache.kafka.connect.json.JsonConverter",                "database.user""DEBEZIUM_PROXY",                "database.dbname""apptest1",                "transforms.MYAPP_SURVEY_RESPONSE.replacement""test1_spli-debezium_app-MYAPP_MYAPP-survey-response_json",                "database.connection.adapter""xstream",                "database.history.kafka.bootstrap.servers""<<kafka host port>>",                "transforms.MYAPP_SURVEY_RESPONSE.type""org.apache.kafka.connect.transforms.RegexRouter",                "database.server.name""test1_spli-debezium_app",                "transforms.MYAPP_SURVEY_RESPONSE.regex"".*MYAPP.MYAPP_SURVEY_RESPONSE",                "database.port""<<port>>",                "key.converter.schemas.enable""false",                "database.hostname""<<host>>",                "database.password""<<pw>>",                "value.converter.schemas.enable""false",                "name""apptest1-xstream-connector",                "transforms.MYAPP_SURVEY_COMPL.replacement""test1_spli-debezium_app-MYAPP_MYAPP-survey-compl_json",                "table.include.list""MYAPP.MYAPP_SURVEY_COMPL,MYAPP.MYAPP_SURVEY_QUESTION,MYAPP.MYAPP_SURVEY_RESPONSE",                "transforms.MYAPP_SURVEY_QUESTION.replacement""test1_spli-debezium_app-MYAPP_MYAPP-survey-question_json"    }} 

      Trace:

      org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.\n\tat io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)\n\tat io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:127)\n\tat oracle.streams.XStreamOut.XStreamOutReceiveLCRCallbackNative(Native Method)\n\tat oracle.streams.XStreamOut.receiveLCRCallback(XStreamOut.java:465)\n\tat io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:108)\n\tat io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:43)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)\n\tat java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\nCaused by: java.lang.NullPointerException\n"  

      Log:

      2022-02-11 10:32:24,358 DEBUG  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Committing offsets   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 INFO   ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} flushing 0 outstanding messages for offset commit   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 DEBUG  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Finished offset commitOffsets successfully in 0 ms   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 ERROR  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted   [org.apache.kafka.connect.runtime.WorkerTask]org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.                at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:127)                at oracle.streams.XStreamOut.XStreamOutReceiveLCRCallbackNative(Native Method)                at oracle.streams.XStreamOut.receiveLCRCallback(XStreamOut.java:465)                at io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:108)                at io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:43)                at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)                at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)                at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)                at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)                at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)                at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)                at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)                at java.base/java.lang.Thread.run(Thread.java:829)Caused by: java.lang.NullPointerException                at io.debezium.connector.oracle.xstream.LcrEventHandler.dispatchDataChangeEvent(LcrEventHandler.java:207)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processRowLCR(LcrEventHandler.java:146)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:114)                ... 12 more2022-02-11 10:32:24,359 INFO   ||  Stopping down connector   [io.debezium.connector.common.BaseSourceTask] 

       

      Show
      Oracle version: Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production   Configuration:   {     "name" :  "apptest1-xstream-connector-2" ,     "config" : {                 "connector.class" :  "io.debezium.connector.oracle.OracleConnector" ,                 "tasks.max" :  "1" ,                 "database.history.kafka.topic" :  "test1_spli-debezium_app_schema-changes" ,                 "transforms.MYAPP_SURVEY_QUESTION.type" :  "org.apache.kafka.connect.transforms.RegexRouter" ,                 "transforms" :  "MYAPP_SURVEY_COMPL,MYAPP_SURVEY_QUESTION,MYAPP_SURVEY_RESPONSE" ,                 "database.tablename. case .insensitive" :  " true " ,                 "transforms.MYAPP_SURVEY_QUESTION.regex" :  ".*MYAPP.MYAPP_SURVEY_QUESTION" ,                 "decimal.handling.mode" :  " double " ,                 "internal.database.oracle.version" :  "11" ,                 "transforms.MYAPP_SURVEY_COMPL.type" :  "org.apache.kafka.connect.transforms.RegexRouter" ,                 "transforms.MYAPP_SURVEY_COMPL.regex" :  ".*MYAPP.MYAPP_SURVEY_COMPL" ,                 "database.history.skip.unparseable.ddl" :  " true " ,                 "database.out.server.name" :  "OUTBOUND_SERVER" ,                 "value.converter" :  "org.apache.kafka.connect.json.JsonConverter" ,                 "database.oracle.version" :  "11" ,                 "key.converter" :  "org.apache.kafka.connect.json.JsonConverter" ,                 "database.user" :  "DEBEZIUM_PROXY" ,                 "database.dbname" :  "apptest1" ,                 "transforms.MYAPP_SURVEY_RESPONSE.replacement" :  "test1_spli-debezium_app-MYAPP_MYAPP-survey-response_json" ,                 "database.connection.adapter" :  "xstream" ,                 "database.history.kafka.bootstrap.servers" :  "<<kafka host port>>" ,                 "transforms.MYAPP_SURVEY_RESPONSE.type" :  "org.apache.kafka.connect.transforms.RegexRouter" ,                 "database.server.name" :  "test1_spli-debezium_app" ,                 "transforms.MYAPP_SURVEY_RESPONSE.regex" :  ".*MYAPP.MYAPP_SURVEY_RESPONSE" ,                 "database.port" :  "<<port>>" ,                 "key.converter.schemas.enable" :  " false " ,                 "database.hostname" :  "<<host>>" ,                 "database.password" :  "<<pw>>" ,                 "value.converter.schemas.enable" :  " false " ,                 "name" :  "apptest1-xstream-connector" ,                 "transforms.MYAPP_SURVEY_COMPL.replacement" :  "test1_spli-debezium_app-MYAPP_MYAPP-survey-compl_json" ,                 "table.include.list" :  "MYAPP.MYAPP_SURVEY_COMPL,MYAPP.MYAPP_SURVEY_QUESTION,MYAPP.MYAPP_SURVEY_RESPONSE" ,                 "transforms.MYAPP_SURVEY_QUESTION.replacement" :  "test1_spli-debezium_app-MYAPP_MYAPP-survey-question_json"     }} Trace: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.\n\tat io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)\n\tat io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:127)\n\tat oracle.streams.XStreamOut.XStreamOutReceiveLCRCallbackNative(Native Method)\n\tat oracle.streams.XStreamOut.receiveLCRCallback(XStreamOut.java:465)\n\tat io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:108)\n\tat io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:43)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)\n\tat java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang. Thread .run( Thread .java:829)\nCaused by: java.lang.NullPointerException\n" Log: 2022-02-11 10:32:24,358 DEBUG  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Committing offsets   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 INFO   ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} flushing 0 outstanding messages for offset commit   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 DEBUG  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Finished offset commitOffsets successfully in 0 ms   [org.apache.kafka.connect.runtime.WorkerSourceTask]2022-02-11 10:32:24,358 ERROR  ||  WorkerSourceTask{id=apptest1-xstream-connector-6-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted   [org.apache.kafka.connect.runtime.WorkerTask]org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.                at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:127)                at oracle.streams.XStreamOut.XStreamOutReceiveLCRCallbackNative(Native Method)                at oracle.streams.XStreamOut.receiveLCRCallback(XStreamOut.java:465)                at io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:108)                at io.debezium.connector.oracle.xstream.XstreamStreamingChangeEventSource.execute(XstreamStreamingChangeEventSource.java:43)                at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)                at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)                at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)                at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)                at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)                at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)                at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)                at java.base/java.lang. Thread .run( Thread .java:829)Caused by: java.lang.NullPointerException                at io.debezium.connector.oracle.xstream.LcrEventHandler.dispatchDataChangeEvent(LcrEventHandler.java:207)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processRowLCR(LcrEventHandler.java:146)                at io.debezium.connector.oracle.xstream.LcrEventHandler.processLCR(LcrEventHandler.java:114)                ... 12 more2022-02-11 10:32:24,359 INFO   ||  Stopping down connector   [io.debezium.connector.common.BaseSourceTask]  

      Hi Debezium Team,

      We are using oracle connector with xstream and the connector always drops Nullpointer excepton.

      We use this configuration in another database (same version, but different schemas and tables) and its works well. Unfortunately, we can’t figure out what is the source of this problem.

              ccranfor@redhat.com Chris Cranford
              koda123456 Koda K (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: