The batch job defined with restartable=false must not be restartable, after failed or stopped.
GlassFish 4.1 results in the following:

[2015-02-26T19:56:34.860+0900] [glassfish 4.1] [SEVERE] [] [] [tid: _ThreadID=25 _ThreadName=Thread-9] [timeMillis: 1424948194860] [levelValue: 1000] [[
javax.batch.operations.JobRestartException: javax.batch.operations.JobRestartException: Job Restartable attribute is false, Job cannot be restarted.

But WildFly tries to execute the stopped or failed job.

Please check the attached test case.

wildfly:
$ mvn clean test -P wildfly-managed (or -P wildly-remote)
glassfish:
$ glassfish4/bin/asadmin start-domain
$ mvn clean test -P glassfish-remote