Sure... it won't hurt a thing. The remote will only pull the amount of power it needs from the adaptor. Having a higher capacity adaptor will never harm any USB charged device.
one way to tell if it harmful to the remote is to feel the heat. if the charger charges too fast, the remote would heat up. heat would reduce battery life over time.