The iMac can probably handle streaming 4k H264 through Plex -- I can smoothly stream 4k from Youtube or Vimeo on my 2015 iMac 27. But your Mac cannot currently handle 4k HEVC. You have apparently acquired or encoded videos on your Plex server as HEVC. That means whatever plays that back must decode it. HEVC is incredibly compute intensive and generally requires hardware acceleration for smooth playback. Your KS8000 TV probably has HEVC acceleration hardware, thus it can play it smoothly.
The 2017 iMac 27 has a Kaby Lake CPU with Quick Sync upgraded to 10-bit 4k HEVC decoding, but the application software (ie playback app) must support this, and maybe also the OS itself. E.g, Quick Sync for H.264 has existed since 2011, yet Premiere Pro still does not support this on Macs, so there can be a significant lag between hardware and software support.
To my knowledge, Plex does not support hardware-accelerated HEVC transcoding on the server side -- it can only stream whatever the encoding format is. Your iMac has a Kaby Lake CPU so the hardware support for HEVC decoding is there; you only need the proper software to support this. I don't think VLC supports this (at least on Mac).
Supposedly macOS High Sierra will have HEVC support. This will vary based on what CPU hardware generation:
http://www.anandtech.com/show/10610...six-notebook-skus-desktop-coming-in-january/3
For Kaby Lake CPUs there will be full support for 4k 10-bit HEVC. The nature of this support may mean OS and library support for developers writing new playback and streaming software, and maybe QuickTime Player and FCPX will be upgraded to use HEVC. Until then, unless you can find some Mac playback software which supports HEVC you will have to wait.
I think Plex may be adding streaming transcoding for HEVC on the server side, so it can do live transcoding from (say) HEVC to H.264. That would also possibly solve your problem. However this is apparently only in beta.