This should work. You should give it a few seconds to unmount the drive before you whip it out. I'm using Semulov, a free utility for your menubar that allows you to eject volumes. Also it supports Growl, so you can get a notification popup that the volume has successfully unmounted.