i had it too
are you using mobile me to push?
if so, turn off contact syncing, and say delete from my iphone when it asks
it'll delete the dupes but not turn off syncing
the only problem is, when sending a text and typing a name to send to, the name still appears twice