From https://github.com/strimzi/strimzi-kafka-operator/issues/3325

While the Reconfigurable interface is part of the public API, it looks like none of the pluggable interface implement it. Some plugins (Authorizer) have logic to handle reconfiguration but it does not seem like this is the case for all of them.