This is a guess as I only have a 1st gen iPod touch (my 4th is being delivered as I type), but it should appear as a Camera/Portable Device under My Computer. I know for sure pictures will appear there, but I am unsure about videos.
Edit: Assuming you are using Windows, you didn't specify.