Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
This happened to me when I had my USB printer sitting atop a small refrigerator. My hypothesis is that the interference it produced when it started cooling was received by the printer and the computer interpreted this as activity on the USB, waking up the computer.

In other words, check if any attached devices may be malfunctioning.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.