Unlikely. Most of the features you mention, didn't exist prior to the iPhone 4. Restoring from an old backup from devices that share very little in common with the current phone, both hardware and software wise, would have minimal to zero impact on battery life.
The simple fact is, the only things you have running are the cell radios on 3G or HSPA+ (still slow and not much of a battery hog), with Siri and Facetime in standby and screen brightness at 25%. That isn't much to tax the battery,,especially in standby mode. I would argue that if you were getting less use than you are, there is something wrong with your phone.
Wait until LTE arrives. Anyone thinks the iPhone 4s sucks at battery life now, is in for a treat.