There is a hidden directory called .Spotlight-V100 at the top of each volume containing several files that store and control it all. Yes, the files are big.
There's not very much exciting in there. There are indexes for metadata and file contents, and some property lists you can use to control what gets indexed.