Uploaded image for project: 'OptaPlanner'
  1. OptaPlanner
  2. PLANNER-2003

CS-D: Loss of incremental performance when using groupBy()

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 7.38.0.Final
    • Fix Version/s: None
    • Component/s: optaplanner-core
    • Labels:
      None
    • Story Points:
      13
    • Workaround Description:
      Hide

      There is no workaround.

      Show
      There is no workaround.
    • Estimated Difficulty:
      High
    • Docs QE Status:
      NEW
    • QE Status:
      NEW

      Description

      In some OptaPlanner examples, we have seen major performance degradation when switching to Constraint Streams. (As much as 95 % of DRL performance can be lost.) This has been shown to come from the way that the groupBy() building block is implemented using Drools.

      The problem gets progressively worse with bigger data sets, clearly pointing to a scalability issue.

      The solution is to redesign the CS-D implementation to handle groupBy() more efficiently. More specifically, the use of more than one from() DRL statement needs to be avoided.

      Some more information can be found in the following working document:

      https://docs.google.com/document/d/1s4pMSN3qLO5LLE7PeMAwj5RQfpzvu8wkqj_t5jB3cEc/edit

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  lpetrovicky Lukáš Petrovický
                  Reporter:
                  lpetrovicky Lukáš Petrovický
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  1 Start watching this issue

                  Dates

                  • Created:
                    Updated: