basically, yeah.
What I do is type the program name in the little search bar in a finder window, and then remove all that stuff. Doing that also gets rid of any residual files associated with the program that just dragging the program itself to the trash. Other than that, drag and empty. Easy - how it should be.