Uploaded image for project: 'JBoss Transaction Manager'
  1. JBoss Transaction Manager
  2. JBTM-3366

When a benchmark fails it does not cause the build to fail

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Major
    • 5.13.0
    • None
    • Performance Testing
    • None
    • Undefined

    Description

      Can more error detection be added so the build can report as failed?

      As an example, if we would run https://github.com/marcosgopen/performance/blob/master/narayana/ArjunaJTA/jta/tests/classes/com/arjuna/ats/jta/xa/performance/JTAStoreTests.java#L51 that would get a number out of JMH that we eventually somehow present as a performance result transactions per second.

      Inside of the jtaTest we return true or false, so we could try to throw a RuntimeException on https://github.com/marcosgopen/performance/blob/703d7c423853eae807dfe1b2cc3139934c196908/narayana/ArjunaJTA/jta/tests/classes/com/arjuna/ats/jta/xa/performance/JTAStoreBase.java#L42. That will be caught and a boolean of false returned to the caller.

      Attachments

        Activity

          People

            rh-ee-msappegr Marco Sappe Griot
            thjenkin@redhat.com Tom Jenkinson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: