Was doing the same for me. Rebooted my AppleTV and it started working. Don't really care for the Remote app though. It's easier to the use the physical one. The app takes too long to find and load, and the buttons get hit accidentally when the screen turns on unintentionally sometimes. Also, the play button is so tiny.