WFCORE-5114 made a slight change with how the configuration API commits the logging changes. When upgrading the core version in wildfly-jar-maven-plugin a test failure occurred in the PR https://github.com/wildfly-extras/wildfly-jar-maven-plugin/pull/137.
The NPE is in the service where the DelayedHandler instance is used, but returns null for some reason. I could not reproduce this locally, however it did happen locally for me with the ascyn-handler in the test. This may be a way to reproduce this locally.