Uploaded image for project: 'OptaPlanner'
  1. OptaPlanner
  2. PLANNER-1082

Create automatic alert on regressions in weekly performance tests

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Major Major
    • 7.18.0.Final
    • None
    • optaplanner-test
    • None
    • 2019 Week 02-04, 2019 Week 05-07
    • 3
    • NEW
    • NEW

      There are performance tests of OptaPlanner running weekly against master branch. To make sure no regression goes unnoticed, create and alert that will e.g. send an email when there is a performance drop.

      This may be a good task for Drools. It would be also beneficial to provide this feature to other KIE perf tests - Drools and jBPM.

      Rules that should be checked (the numbers might change, just for illustration):

      • a single regression > 10%
      • multiple regressions > 5%
      • last 5 results dropped by > 10% in total

            rsynek@redhat.com Radovan Synek
            rsynek@redhat.com Radovan Synek
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: