Hmmm... this happened to me with my old second generation iPod Nano.
You must make sure that your Mac/PC time zone is the correct one you are in, make sure the time and date are correct...
This solved my problem... haven't had any problems with my iPod Touch so far regarding time and date.
Hope this helps.