Thanks, just asked a friend who was having the same problem on a 2009 MBP on ML if removing 'Android File Transfer' fixed it for him (since he recently tried out a Nexus 7) and he said it worked.
So I did the same on my machine and expect the same results.
I never could isolate it because I tried out my first Android, the Galaxy Nexus, in the middle of last summer; same time as ML release.
So I always attributed it to the OS, not some particular app or functionality.
Thanks!
I updated original post title so people don't have to sift through this read for a quick solution.