If you download it from iTMS: ~/Music/iTunes/Album Artwork/Download/
If you paste it from elsewhere it's embedded in the individual music files.
Wait, what do you mean by thumbnails...? Is that the ones shown in Coverflow? If so, they're in ~/Music/iTunes/Album Artwork/Local/