If you're on Lion, when you close an app without closing the application's windows first (e.g. quit word without closing all your word documents) the default behaviour is to reopen those windows next time you start the app. To avoid this, close your documents before you quit the app.