How to reproduce

install operator 1.16 which supports versioned tasks

after operator is installed, change the resolverTasks value in addon to false

after that, if you check the tasks in openshift-pipelines namespace you'll see that various tasks are still present even though they should have been removed.
(this is present for versioned stepactions & versioned clustertasks as well)