the UI tests we run should not trigger hits in our usage tracking. The plugin has a preferences setting that disables reporting.
It looks like we disable reporting for our UI test by having a custom config.ini for our UI tests.

The "org.jboss.tools.usage" bundle has 2 preferences settings:

"allowUsageReportPreference"

Furthermore the usage plugin shall not pop up a dialog that asks the user if he allows us to report hits. This can be done with

"askUserForUsageReportPreference"

Both are in the Configuration Scope (common to all workbenches of a particular eclipse instance).

For further lookup @see IUsageReportPreferenceConstants#USAGEREPORT_ENABLED_ID and IUsageReportPreferenceConstants#ASK_USER_USAGEREPORT_ID