Doesn't sound like a problem, just a RTT delay from Mail.app to the servers and back.
Did you set your Mail.app email accounts up for IMAP or POP? If it's POP, I can understand, but IMAP, there might be an issue.
Also, do you have any apps that take significant bandwidth?