-
Enhancement
-
Resolution: Done
-
Minor
-
None
-
None
-
None
-
NEW
-
NEW
Statistical benchmarking now requires to set environment mode PRODUCTION manually.
But in that case, they aren't reproducible.
Reproducible statistical benchmarking means that subSingle 0 get random seed 0, subSingle 1 gets random seed 1, etc.
- relates to
-
PLANNER-401 Statistical benchmarking: run each single benchmark n times and average the results
-
- Resolved
-