Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-15589

[GSS] (7.1.z) undeploy and shutdown hang by JdbcRepository error

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • None
    • 7.1.4.GA
    • Batch
    • None
    • Hide

      Environment

      • EAP 7
      • Configure jdbc-job-repository
        ex) standalone.xml
                <subsystem xmlns="urn:jboss:domain:batch-jberet:1.0">
            <default-job-repository name="OracleDS"/>
            <default-thread-pool name="batch"/>
            <job-repository name="in-memory">
                <in-memory/>
            </job-repository>
            <job-repository name="OracleDS">
                <jdbc data-source="OracleDS"/>
            </job-repository>
            <thread-pool name="batch">
                <max-threads count="10"/>
                <keepalive-time time="30" unit="seconds"/>
            </thread-pool>
        </subsystem>
      • Deploy batch-processing(jboss-batch-processing.war) in EAP 7 quickstarts

      Step
      1. Run the EAP 7
      2. Access the running application in a browser at the following URL: http://localhost:8080/jboss-batch-processing/
      3. Click on "Generate a new file and start import job" button.
      4. Stop database of jdbc-job-repository.
      5. Undeploy jboss-batch-processing.war or shutdown EAP server.
      6. You can confirm following error. JBatch application cannot undeploy and EAP server cannot shutdown.

      2018-10-04 11:58:16,933 ERROR [stderr] (ServerService Thread Pool -- 69) Exception in thread "ServerService Thread Pool -- 69" javax.batch.operations.BatchRuntimeException: JBERET000626: Failed to run SELECT JOB_EXECUTION.JOBEXECUTIONID FROM JOB_EXECUTION INNER JOIN JOB_INSTANCE ON JOB_EXECUTION.JOBINSTANCEID=JOB_INSTANCE.JOBINSTANCEID WHERE JOB_EXECUTION.BATCHSTATUS IN ('STARTED', 'STARTING') AND JOB_INSTANCE.JOBNAME=?
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:653)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.job.repository.JobRepositoryService.getRunningExecutions(JobRepositoryService.java:139)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.job.repository.JdbcJobRepositoryService.getRunningExecutions(JdbcJobRepositoryService.java:44)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.operations.AbstractJobOperator.getRunningExecutions(AbstractJobOperator.java:212)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.getRunningExecutions(JobOperatorService.java:192)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.lambda$stopRunningJobs$0(JobOperatorService.java:444)
2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.WildFlyJobOperator.allowMissingJob(WildFlyJobOperator.java:68)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.stopRunningJobs(JobOperatorService.java:444)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.access$800(JobOperatorService.java:409)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.lambda$stop$1(JobOperatorService.java:127)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.lang.Thread.run(Thread.java:748)
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jboss.threads.JBossThread.run(JBossThread.java:320)
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) Caused by: java.sql.SQLRecoverableException: No more data to read from socket
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:281)
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:137)
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:250)
2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:330)
2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:355)
2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:598)
2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1102)
2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1051)
2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:619)
2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1039)
2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:1146)
2018-10-04 11:58:16,940 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1472)
2018-10-04 11:58:16,944 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3889)
2018-10-04 11:58:16,947 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3959)
2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:4515)
2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:504)
2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:647)
2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	... 13 more
      Show
      Environment EAP 7 Configure jdbc-job-repository ex) standalone.xml <subsystem xmlns= "urn:jboss:domain:batch-jberet:1.0" > < default -job-repository name= "OracleDS" /> < default -thread-pool name= "batch" /> <job-repository name= "in-memory" > <in-memory/> </job-repository> <job-repository name= "OracleDS" > <jdbc data-source= "OracleDS" /> </job-repository> <thread-pool name= "batch" > <max-threads count= "10" /> <keepalive-time time= "30" unit= "seconds" /> </thread-pool> </subsystem> Deploy batch-processing(jboss-batch-processing.war) in EAP 7 quickstarts Step 1. Run the EAP 7 2. Access the running application in a browser at the following URL: http://localhost:8080/jboss-batch-processing/ 3. Click on "Generate a new file and start import job" button. 4. Stop database of jdbc-job-repository. 5. Undeploy jboss-batch-processing.war or shutdown EAP server. 6. You can confirm following error. JBatch application cannot undeploy and EAP server cannot shutdown. 2018-10-04 11:58:16,933 ERROR [stderr] (ServerService Thread Pool -- 69) Exception in thread "ServerService Thread Pool -- 69" javax.batch.operations.BatchRuntimeException: JBERET000626: Failed to run SELECT JOB_EXECUTION.JOBEXECUTIONID FROM JOB_EXECUTION INNER JOIN JOB_INSTANCE ON JOB_EXECUTION.JOBINSTANCEID=JOB_INSTANCE.JOBINSTANCEID WHERE JOB_EXECUTION.BATCHSTATUS IN ('STARTED', 'STARTING') AND JOB_INSTANCE.JOBNAME=? 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:653) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.job.repository.JobRepositoryService.getRunningExecutions(JobRepositoryService.java:139) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.job.repository.JdbcJobRepositoryService.getRunningExecutions(JdbcJobRepositoryService.java:44) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.operations.AbstractJobOperator.getRunningExecutions(AbstractJobOperator.java:212) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.getRunningExecutions(JobOperatorService.java:192) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.lambda$stopRunningJobs$0(JobOperatorService.java:444) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.WildFlyJobOperator.allowMissingJob(WildFlyJobOperator.java:68) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.stopRunningJobs(JobOperatorService.java:444) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.access$800(JobOperatorService.java:409) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.lambda$stop$1(JobOperatorService.java:127) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.lang.Thread.run(Thread.java:748) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jboss.threads.JBossThread.run(JBossThread.java:320) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) Caused by: java.sql.SQLRecoverableException: No more data to read from socket 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:281) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:137) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:250) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:330) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:355) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:598) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1102) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1051) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:619) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1039) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:1146) 2018-10-04 11:58:16,940 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1472) 2018-10-04 11:58:16,944 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3889) 2018-10-04 11:58:16,947 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3959) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:4515) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:504) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:647) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) ... 13 more

    Description

      JBatch application undeploy and EAP server shutdown process hang by JdbcRepository of JBatch application.

      Attachments

        Issue Links

          is cloned by

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-17944 [GSS] (7.2.z) undeploy and shutdown hang by JdbcRepository error

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified
          is related to

          Bug - A problem that impairs or prevents the functions of the product. JBERET-458 getRunningExecutions() should look in cache as fallback

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved
          relates to

          Bug - A problem that impairs or prevents the functions of the product. WFLY-11139 Exception from getRunningExecutions method causes undeployment to hang

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open

          Activity

            People

              cfang@redhat.com Cheng Fang
              rhn-support-enagai Eiichi Nagai (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: