-
Bug
-
Resolution: Done
-
Optional
-
7.32.0.Final
-
None
-
2023 Week 09-11 (from Feb 27)
-
NEW
-
NEW
Expected behavior:
When running a benchmark with a warmup period of 30 seconds and an erroneous customProperty in the solver config, the benchmark should fail immediately and not spend the 30 seconds on warmup
Observed behavior:
The expected IllegalArgumentException is raised after 30 seconds of warmup time
How to reproduce:
- Configure warmUpSecondsSpentLimit of 30 seconds in plannerBenchmark
- Configure a solver config with a custom phase and custom property value "NONEXISTING" (in our case it was an invalid Enum value)
- Launch the benchmark
- Exception is raised too late in `DefaultPlannerBenchmark.benchmarkEnded()`