Uploaded image for project: 'JBoss Transaction Manager'
  1. JBoss Transaction Manager
  2. JBTM-3366

When a benchmark fails it does not cause the build to fail

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • 5.13.0
    • None
    • Performance Testing
    • None
    • Undefined

      Can more error detection be added so the build can report as failed?

      As an example, if we would run https://github.com/marcosgopen/performance/blob/master/narayana/ArjunaJTA/jta/tests/classes/com/arjuna/ats/jta/xa/performance/JTAStoreTests.java#L51 that would get a number out of JMH that we eventually somehow present as a performance result transactions per second.

      Inside of the jtaTest we return true or false, so we could try to throw a RuntimeException on https://github.com/marcosgopen/performance/blob/703d7c423853eae807dfe1b2cc3139934c196908/narayana/ArjunaJTA/jta/tests/classes/com/arjuna/ats/jta/xa/performance/JTAStoreBase.java#L42. That will be caught and a boolean of false returned to the caller.

              rh-ee-msappegr Marco Sappe Griot
              thjenkin@redhat.com Tom Jenkinson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: