Modern lithium batteries are pretty good at handling a faster charge without damaging them. The only issue I can potentially see is if you're using a 12watt charger AND doing something intensive on the phone, it could result in quite a bit of heat. Which lithium batteries don't like too much.
Apple has never made any indication that there is anything unsafe about using the 12w adapter while using an iPhone.