Do you mean Airplay? That could be slow for a variety of reasons. As I understand, the iMac is compressing the screen image into H.264 video "on the fly" and that might be pretty fast if you are already viewing an h.264 video on the iMac, but very slow for other things.
I have two Apple TV-HD's but hardly ever use Airplay. I have a 2014 Mini (running Mojave) that I use as an "iTunes Server" with about 1200 movies/tv shows on a 4tb SSD. These play really smoothly on the two AppleTV's (one is on 802.11ac wifi, the other is on gigabit ethernet).
One issue for you might be the ethernet connection however, which is limited to 100mbit/sec. Do you have a router that can do 802.11ac wifi? That might be about 5x faster than the ethernet on the AppleTV-HD, maybe it would help?