Setting the same reference property (either single or multi-valued) multiple times with the same value (reference), causes the number of referrers to be increased & stored each time within the referring node.

Because of this, after removing the property (calling remove once) the referenced node still appears as having referrers which prevents it from being removed.