My email opens up very fast and downloads right away.
Maybe something not setup correct on your mail setup?
I'd try removing the email account and re add it. What kind of email address is it?
Make sure you got the incoming and outgoing server info entered correctly along with correct server port and other settings.
It shouldn't take a minute loading each time.