Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
If you download it from iTMS: ~/Music/iTunes/Album Artwork/Download/

If you paste it from elsewhere it's embedded in the individual music files.

Wait, what do you mean by thumbnails...? Is that the ones shown in Coverflow? If so, they're in ~/Music/iTunes/Album Artwork/Local/
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.