Adding or removing JBOD volumes not working as expected

On newer Kubernetes versions, AMQ Streams is not able to add / remove JBOD volumes. Due to some changes (improved validation) in the StatefulSet controller in newer Kube versions, the STS controller will not allow the pods to be deleted and recreated out-of-order. It will allow it only when they are deleted and recreated in the ordered way (first pod-0, then pod-1, ...). This is not how our rolling update procedure works right now (unless - it by coincidence falls into this order which would for example expect that controller is the last node etc.)

This was raised in  Strimzi#3136 which also contains some more details.

The current workaround is manually delete all pods / delete them in order. Once the pods are recreated, the STS keeps working properly.