Five restores? I wish!! I've restored mine 21 times since July 11th. That's right, TWENTY-ONE.
Three of those were caused by trying to restore from a backup (which failed all three times, requiring an immediate follow-up restore) but the other 18 were all caused either by installing/removing/updating apps, or interrupting the syncing process. My suggestion is to just let it do its thing, no matter how long it takes (updating Enigmo today, for example, took about five minutes - and that was the only thing I did on that particular sync) ... Also, if you see the activity indicator spinning (next to the 3G/wifi indicator) don't even think about touching the phone, unless you really want to make it freeze again.
I hope Apple fixes this soon. I don't know about you, but I think 21 restores in less than two weeks is a bit excessive. 😉