If you have a Mac, the new mail "schwing" is on your computer.
/Applications/Mail.app/Contents/Resources/New Mail.aiff
There's also a Mail Fetch Error.aiff, Mail Sent.aiff (whoosh!), and No Mail.aiff.
The Ding SMS sound that sounds like the SMS sound is also on your Mac:
/System/Library/Sounds/Glass.aiff