When you remove the operator, the console asks you whether you also want to remove the resources. This definitely removes the Istio resource, but the operation does not appear to remove CRDs.

Marko's initial thought is the only reason CRDs are retained by default is because there might be some resources that are still present. He asked me to create this so it can be looked into further.