Apple GPUs don't suck, they are actually very good in several respects, and impressively performant given their targeted power envelope.That's because Apple GPU sucks. Simple. Beside, their Metal API also sucks that a lot of software don't event use it unless they really need it such as Adobe.
Apple isn't trying to make better GPU while focus on software aspects such as Metal API which is a huge problem. The hardware itself is slow so CUDA stuff is pointless. You better check TFLOP of Apple GPU compared to Nvidia GPU. Hell, they even advertised that M1 Max = mobile 3080, M1 Ultra = 3090 and yet none of them were able to reach that.
Apple is just not good at making good GPU, that's all. Nothing new since Mac was never known of great GPU performance.
And that is the key, really - what kind of devices make sense for Apple to build? Pure compute boxes arguably don't, there is little there in terms of added value that Apple can provide. If I submit an over-night molecular dynamics run, I don't care about the box it's running on. I just want it to be finished in the morning. And even if Apple did provide a box with the desired performance, the software still runs under Linux only. The same would go for any really long computational task. It is not interactive, and can run anywhere really, preferably elsewhere actually since the systems tend to be noisy.
As far as gaming is concerned, it is predominantly a software issue. I run Baldurs Gate 3 on both my Mac Studio Max, and on my Windows gaming box (with a somewhat under volted and under clocked RX6700XT in order to cut down power draw) and the systems perform similarly, within the limitation of simply having an fps counter and no facility for benchmarking. Only, the Mac Studio draws less power than the GPU chip alone on my gaming box. Another way to look at it is that the Mac Studio is roughly on par with a PS5, but at (less than) half the power.
So - should Apple allow the GPU to draw 5-10 times more power? Personally, I don't think so. The Studio is a delightful little stationary system and given Apples inability to implement reasonable fan control, I don't want more heat generated. It would serve literally no purpose for either the photo editing or the (light) video editing I do on the system, and we have ample examples of it handling far, far more strenuous video editing than typically required. Again, what is lacking in this thread are good examples of WHY Apple should build systems with far more power draw. It's not that applications that could benefit do not exist, we all know they do, but do they exist on MacOS, and is there a reasonable estimate of just how many such Apple systems would be actually be sold for the odd app that is? How many Mac Pros sold last year? Does the realistic sales volume justify the engineering and opportunity cost?
As far as I can see, it is all forum tech-wankery.