The credential store allows different types to be stored under the same alias, removal requires the type to be specified so the correct entry can be removed.

However there is no way to list the types stored under a specific alias so unless you know how the store was populated it can be impossible to remove an alias.