Uploaded image for project: 'AppFormer'
  1. AppFormer
  2. AF-1459

Improve speed of kie-wb-common-compiler tests

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • None
    • None
    • AppFormer Foundation
    • None

      After merging initial maven code in https://github.com/kiegroup/kie-wb-common/pull/1973
      quite a lot of integration tests were introduced, which test the featue (using external maven).

      The problem is, that these tests are too slow (they take ~23 minutes to execute on Jenkins). Up until now the slowests tests were drools tests (there are many thousands of them) that take about 9 minutes to execute. We can't afford to add another 23 minutes to the build time of every full downstream build so we should invest some time into making these tests faster.

      How to check the speed: download build log and grep for line containing duration of compiler tests like this:

      wget --output-document=build.log https://kie-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/kie-wb-common-pullrequests/4398/consoleText
grep 'Time elapsed: .* sec - in org.kie.workbench.common.services.backend.compiler' build.log | | sort -rnk12

      Here is a sample output showing which tests are slow:

      grep -E 'Time elapsed: .* sec - in org.kie.workbench.common.services.backend.compiler' build.log | sort -rnk12
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 505.654 sec - in org.kie.workbench.common.services.backend.compiler.ConcurrentBuildTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.579 sec - in org.kie.workbench.common.services.backend.compiler.impl.classloader.CompilerClassloaderUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 131.6 sec - in org.kie.workbench.common.services.backend.compiler.plugin.KieMetadataTest
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.886 sec - in org.kie.workbench.common.services.backend.compiler.service.DefaultKieCompilerServiceTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.131 sec - in org.kie.workbench.common.services.backend.compiler.DefaultMavenCompilerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.925 sec - in org.kie.workbench.common.services.backend.compiler.rest.client.MavenRestClientTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.96 sec - in org.kie.workbench.common.services.backend.compiler.service.executors.DefaultLocalExecutorTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.335 sec - in org.kie.workbench.common.services.backend.compiler.ClassLoaderProviderTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.765 sec - in org.kie.workbench.common.services.backend.compiler.kie.KieDefaultMavenCompilerTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.848 sec - in org.kie.workbench.common.services.backend.compiler.service.executors.DefaultRemoteExecutorTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.233 sec - in org.kie.workbench.common.services.backend.compiler.DefaultMavenIncrementalCompilerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.503 sec - in org.kie.workbench.common.services.backend.compiler.impl.decorators.KieAfterDecoratorTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.27 sec - in org.kie.workbench.common.services.backend.compiler.kie.KieDefaultMavenIncrementalCompilerTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.242 sec - in org.kie.workbench.common.services.backend.compiler.impl.decorators.OutputLogAfterDecoratorTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.145 sec - in org.kie.workbench.common.services.backend.compiler.kie.KieClassLoaderProviderTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.681 sec - in org.kie.workbench.common.services.backend.compiler.impl.decorators.JGITCompilerBeforeDecoratorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.877 sec - in org.kie.workbench.common.services.backend.compiler.impl.decorators.ClasspathDepsAfterDecoratorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.97 sec - in org.kie.workbench.common.services.backend.compiler.MavenOutputTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.231 sec - in org.kie.workbench.common.services.backend.compiler.kie.KieMavenOutputTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.001 sec - in org.kie.workbench.common.services.backend.compiler.rest.server.MavenRestHandlerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.178 sec - in org.kie.workbench.common.services.backend.compiler.utils.JGitUtilsTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.023 sec - in org.kie.workbench.common.services.backend.compiler.utils.MavenUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.1 sec - in org.kie.workbench.common.services.backend.compiler.impl.pomprocessor.DefaultPomEditorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 sec - in org.kie.workbench.common.services.backend.compiler.MavenParameterTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec - in org.kie.workbench.common.services.backend.compiler.configuration.ConfigurationTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in org.kie.workbench.common.services.backend.compiler.DefaultIncrementalCompilerEnablerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in org.kie.workbench.common.services.backend.compiler.impl.incrementalenabler.DefaultIncrementalCompilerEnablerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in org.kie.workbench.common.services.backend.compiler.impl.WorkspaceCompilationInfoTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in org.kie.workbench.common.services.backend.compiler.impl.kie.KieMavenCompilerFactoryTest

              mdessi-1 Massimiliano Dessi
              jhrcek Jan Hrcek (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: