Repeated toggling of JAX-RS support on project does not cause it to rebuild

When JAX-RS support is toggled in a project's preferences, clicking Apply will rebuild the project and JAX-RS services will (dis)/appear and validation is enabled/disabled.

But if without closing the preferences I toggle JAX-RS support again and press Apply, nothing happens - the project is not built with the new settings.