I've gone down at like 4-5am before... It's actually fun. Tends to be a good atmosphere, and everyone gets along.
Wouldn't go so far as to go down there the day before though
Never understood how that many people could have both that much free time and enough cash to actually afford stuff in an Apple Store.