Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
You don't have to do anything special, just download the new version you want and put it in your Applications folder, overwriting the old one.

Firefox settings/bookmarks etc. are kept in ~/Library/Application Support/Firefox so they will be kept.

Why do you need to reinstall though? If you are having problems there is a chance it is caused by an extension and those will also be retained.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.