Apple Mail - Unflagging Mail problem

All my mail from Gmail, Yahoo, Windows Live, it all downloads into Apple Mail with the "blue ball" (new mail), and "red flagged" already. This began when I upgraded to Tiger a few years back and now it remains even in Leopard and Snow Leopard.

Anyone know how I can have my email download without being red flagged?

Thanks, and cheers!

Sam