How to keep my Mac from automatically storing pictures I see in the Mail application?

It seems that everytime I open an e-mail that has a photo in it, my computer automatically stores the picture. If you type "." a bunch of pictures from my e-mail come up.

My questions are:

1. How do I keep it from storing the pictures?

2. How do I clean it up?

Thanks