Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Sure... it won't hurt a thing. The remote will only pull the amount of power it needs from the adaptor. Having a higher capacity adaptor will never harm any USB charged device.
 
one way to tell if it harmful to the remote is to feel the heat. if the charger charges too fast, the remote would heat up. heat would reduce battery life over time.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.