Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-15589

[GSS] (7.1.z) undeploy and shutdown hang by JdbcRepository error

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Deferred
    • Affects Version/s: 7.1.4.GA
    • Fix Version/s: None
    • Component/s: Batch
    • Labels:
      None
    • Target Release:
    • Steps to Reproduce:
      Hide

      Environment

      • EAP 7
      • Configure jdbc-job-repository
        ex) standalone.xml
                <subsystem xmlns="urn:jboss:domain:batch-jberet:1.0">
                    <default-job-repository name="OracleDS"/>
                    <default-thread-pool name="batch"/>
                    <job-repository name="in-memory">
                        <in-memory/>
                    </job-repository>
                    <job-repository name="OracleDS">
                        <jdbc data-source="OracleDS"/>
                    </job-repository>
                    <thread-pool name="batch">
                        <max-threads count="10"/>
                        <keepalive-time time="30" unit="seconds"/>
                    </thread-pool>
                </subsystem>
        
      • Deploy batch-processing(jboss-batch-processing.war) in EAP 7 quickstarts

      Step
      1. Run the EAP 7
      2. Access the running application in a browser at the following URL: http://localhost:8080/jboss-batch-processing/
      3. Click on "Generate a new file and start import job" button.
      4. Stop database of jdbc-job-repository.
      5. Undeploy jboss-batch-processing.war or shutdown EAP server.
      6. You can confirm following error. JBatch application cannot undeploy and EAP server cannot shutdown.

      2018-10-04 11:58:16,933 ERROR [stderr] (ServerService Thread Pool -- 69) Exception in thread "ServerService Thread Pool -- 69" javax.batch.operations.BatchRuntimeException: JBERET000626: Failed to run SELECT JOB_EXECUTION.JOBEXECUTIONID FROM JOB_EXECUTION INNER JOIN JOB_INSTANCE ON JOB_EXECUTION.JOBINSTANCEID=JOB_INSTANCE.JOBINSTANCEID WHERE JOB_EXECUTION.BATCHSTATUS IN ('STARTED', 'STARTING') AND JOB_INSTANCE.JOBNAME=?
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:653)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.job.repository.JobRepositoryService.getRunningExecutions(JobRepositoryService.java:139)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.job.repository.JdbcJobRepositoryService.getRunningExecutions(JdbcJobRepositoryService.java:44)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.operations.AbstractJobOperator.getRunningExecutions(AbstractJobOperator.java:212)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.getRunningExecutions(JobOperatorService.java:192)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.lambda$stopRunningJobs$0(JobOperatorService.java:444)
      2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.WildFlyJobOperator.allowMissingJob(WildFlyJobOperator.java:68)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.stopRunningJobs(JobOperatorService.java:444)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.access$800(JobOperatorService.java:409)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.lambda$stop$1(JobOperatorService.java:127)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) 	at java.lang.Thread.run(Thread.java:748)
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jboss.threads.JBossThread.run(JBossThread.java:320)
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) Caused by: java.sql.SQLRecoverableException: No more data to read from socket
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:281)
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:137)
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:250)
      2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:330)
      2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:355)
      2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:598)
      2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1102)
      2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1051)
      2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:619)
      2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
      2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1039)
      2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:1146)
      2018-10-04 11:58:16,940 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1472)
      2018-10-04 11:58:16,944 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3889)
      2018-10-04 11:58:16,947 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3959)
      2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:4515)
      2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:504)
      2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:647)
      2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) 	... 13 more
      
      Show
      Environment EAP 7 Configure jdbc-job-repository ex) standalone.xml <subsystem xmlns= "urn:jboss:domain:batch-jberet:1.0" > < default -job-repository name= "OracleDS" /> < default -thread-pool name= "batch" /> <job-repository name= "in-memory" > <in-memory/> </job-repository> <job-repository name= "OracleDS" > <jdbc data-source= "OracleDS" /> </job-repository> <thread-pool name= "batch" > <max-threads count= "10" /> <keepalive-time time= "30" unit= "seconds" /> </thread-pool> </subsystem> Deploy batch-processing(jboss-batch-processing.war) in EAP 7 quickstarts Step 1. Run the EAP 7 2. Access the running application in a browser at the following URL: http://localhost:8080/jboss-batch-processing/ 3. Click on "Generate a new file and start import job" button. 4. Stop database of jdbc-job-repository. 5. Undeploy jboss-batch-processing.war or shutdown EAP server. 6. You can confirm following error. JBatch application cannot undeploy and EAP server cannot shutdown. 2018-10-04 11:58:16,933 ERROR [stderr] (ServerService Thread Pool -- 69) Exception in thread "ServerService Thread Pool -- 69" javax.batch.operations.BatchRuntimeException: JBERET000626: Failed to run SELECT JOB_EXECUTION.JOBEXECUTIONID FROM JOB_EXECUTION INNER JOIN JOB_INSTANCE ON JOB_EXECUTION.JOBINSTANCEID=JOB_INSTANCE.JOBINSTANCEID WHERE JOB_EXECUTION.BATCHSTATUS IN ('STARTED', 'STARTING') AND JOB_INSTANCE.JOBNAME=? 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:653) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.job.repository.JobRepositoryService.getRunningExecutions(JobRepositoryService.java:139) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.job.repository.JdbcJobRepositoryService.getRunningExecutions(JdbcJobRepositoryService.java:44) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.operations.AbstractJobOperator.getRunningExecutions(AbstractJobOperator.java:212) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.getRunningExecutions(JobOperatorService.java:192) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.lambda$stopRunningJobs$0(JobOperatorService.java:444) 2018-10-04 11:58:16,934 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.WildFlyJobOperator.allowMissingJob(WildFlyJobOperator.java:68) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.stopRunningJobs(JobOperatorService.java:444) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService$BatchJobServerActivity.access$800(JobOperatorService.java:409) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at org.wildfly.extension.batch.jberet.deployment.JobOperatorService.lambda$stop$1(JobOperatorService.java:127) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2018-10-04 11:58:16,935 ERROR [stderr] (ServerService Thread Pool -- 69) at java.lang.Thread.run(Thread.java:748) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jboss.threads.JBossThread.run(JBossThread.java:320) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) Caused by: java.sql.SQLRecoverableException: No more data to read from socket 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:281) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:137) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:250) 2018-10-04 11:58:16,936 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:330) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:355) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:598) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1102) 2018-10-04 11:58:16,937 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1051) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:619) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:1039) 2018-10-04 11:58:16,938 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:1146) 2018-10-04 11:58:16,940 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1472) 2018-10-04 11:58:16,944 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3889) 2018-10-04 11:58:16,947 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3959) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:4515) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:504) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) at org.jberet.repository.JdbcRepository.getRunningExecutions(JdbcRepository.java:647) 2018-10-04 11:58:16,948 ERROR [stderr] (ServerService Thread Pool -- 69) ... 13 more

      Description

      JBatch application undeploy and EAP server shutdown process hang by JdbcRepository of JBatch application.

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  cfang Cheng Fang
                  Reporter:
                  enagai Eiichi Nagai
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: