It would be wise to sync them, but if you don't, you should be careful. I have upgraded and/or exchanged at the apple store and at AT&T a total of 3 times and when i did so, they had a machine or process to transfer those contacts over, so I had no problem. Just use caution cause a wipe or restore could delete them.