Currently, when you build with -DskipTests, the baseline checks are also skipped. This means that if you make a change to a file in a plugin, and build it locally to see if anything breaks, but forget to bump the version of the plugin and its containing feature, you won't see the baseline check failure until it's built in Jenkins and someone like me complains about it to you directly.

This happened recently in the 4.4.x branch for changes to openshift and base.

So I propose this change in parent pom for 4.4.x and master branches:

-               <skipBaselineComparison>${skipTestsOrITests}</skipBaselineComparison>
+               <skipBaselineComparison>false</skipBaselineComparison>