Applications are kept in your Applications folder. You can get to this by opening a new Finder window (ie. open any folder) and clicking on Applications under Favourites in the sidebar on the left.
Your instinct to back up is a good one to have, but you'll be better off backing up your whole system with Time Machine than saving individual applications, which you can redownload from the App Store at any time anyway.