When you double click open an attachment, it copies to a hidden folder that the given app reads. Once created, it's independent of the mail app and unless you save as, keeps changes in the same place.
In finder, option click GO and click library. Then click mail downloads. Look through them just in case, then trash the files inside the MD folder.