Now, if you want to see the speedup of switching from drools-core 5.3 to 5.4 or planner-core from 5.3 to 5.4, you need to:

• run both of them in a separate benchmark run (this is normal)
• manually start comparing those results and using OpenOffice to draw graphs. => Annoying
  Planner should be able to pick up the old benchmark results and throw them in the graph.

This relates to JBRULES-3473 and should probably be fixed together.