Apple TV is synced with your iTunes library, so in order to stream the files, your iTunes computer must be on...or at least 'wake'able. If you can view those Time Capsule stored movies in iTunes now, you can easily watch them on ATV.
May I caution you that if you TC dies that you lose all of your movies...assuming you don't have another backup.