The system will prevent you from deleting certain apps. Mail is one of those. You can force delete any app by logging on as a "Root" user but that is dangerous and can cause other problems. The correct answer has already been given. If you don't like an Apple installed app, then just don't use it. This isn't Windows.