You probably have a good idea by now but it is mostly down to games. I'm not a huge gamer but if large, impressive titles come out that interest me then that may make me reconsider but even just now on both my 64gb iPads, I have well over half the storage free. I'm sure 32gb will be sufficient but I'll certainly monitor things for the first couple of weeks.
Apps/games on the Apple TV are limited to 200MB plus can download up to 2GB while in use. The second you exit the game/app, that space is free to be overwritten by anything that needs the space (like another game).
Because of the huge bandwidth requirements of doing this, it's unlikely most games will have a lot of downloadable bits as even 500MB becomes huge when you consider thousands of users will be downloading it almost every time they play your game.
Unless you like storing tons of photos on the device or lots of games you're unlikely to play often, the 64GB doesn't really offer much advantage.