When I need to replace an image in the DMS, I usually first delete the old image and then add the same image again. But the DMS doesn't completely remove the image, so that when I add the same image back in, it gets re-named (appended with a number). See screenshot.