Weird compatibility issue? I still don't understand though. Is your Mac rendering internally at 3840x2160 or at 7680x4320? IOW, when you say scaled, is it 2X scaled on the Mac and then downsampled for output at 6144x3456, or is it output at 3840x2160 and then scaled by the monitor?I can only assume it does.
Just sharing my experience that my M4 iPP pumps 3840x2160/60Hz/HDR via a TB5 cable to the G32P (while the M4 MBA does not) 🤷♂️
From my M4 Mac mini, I can run 3840x2560 (3:2 monitor) / 60 Hz / HDR via a TB4 cable to my Huawei monitor, but that is the native resolution, so not scaled on the Mac.
I normally run at 2560x1707 though, so the resolution rendered is 5120x3414.

Also, you mentioned that you are getting 80 Gbps DSC, but if you have DSC, you don't need 80 Gbps for 6K / 60 Hz / HDR. Conversely, if you have 80 Gbps, you don't need DSC for 6K / 60 Hz / HDR.