Uploaded image for project: 'OptaPlanner'
  1. OptaPlanner
  2. PLANNER-333

Benchmark report's best score summary should clearly report if a score is not completely initialized

XMLWordPrintable

      To reproduce:

      • Use the cloud balancing benchmark config xml
      • Replace the solver phases with Brute Force and Branch And Bound
      • Limit termination to 30 seconds
      • Use datasets 100comps and 200comps
      • Run it
      • Notice how in the best score summary (as well as some of the other summary's probably), the Brute Force score seems to be perfect. It's not. There simply was no score.
      • Notice how in the best score summary (as well as some of the other summary's probably), the Branch And Bound algorithm has a score, but the claim is that it's not entirely initialized. They said their proved this with the logs (but I am unsure, because BaB can looked at initialized solution and later still have steps that look at a non initialized solution).

      In any case, if the score is uninitialized, there should be a red "Unable to render embedded object: File (", similar to the orange ") not found." if the score is not feasible.

            oskopek Ondrej Skopek (Inactive)
            gdesmet@redhat.com Geoffrey De Smet (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: