You're not the only one with this issue. I've been trying all day with hardly any luck. It worked fine when I first got the phone (fresh install, straight out of the box) but once I restored all of my data, settings, etc. that's when it started acting up.
I hope Apple gets this fixed soon