Regarding the Macpro as a possible AI machine - so far there's been no reasons stated why this could happen.
The other issue here is the increasing concerns (found all over the press) that AI companies are currently over-valued in comparison to any possible future profits, and that the AI bubble is currently fit to burst. Companies like NVIDIA and Meta are "riding the tiger" - they're already all-in on AI - and have no choice but to keep doubling down, but Apple still has the choice to maybe stay on the sidelines until the "re-adjustment" hits.
For better or worse, Apple were late to the game on AI services and AI development - they'd have their work cut out playing catchup with NVIDIA et. al. even if the current growth rate continues, but sinking investment into developing AI training hardware now runs a real risk of going up in smoke when the crash comes. NVIDIA, Meta etc. might survive, but these crashes tend to be last-in, first-out... Even if someone wanted to get a stake in the AI boom right now, I don't think it's the right time to go for the "plucky outsider" rather than someone who actually has product right now.
Apple's decision to license tech from existing AI giants, use third-party training hardware etc. rather than roll their own could prove to be very, very astute.
What Apple
do have is a great platform for
consuming AI services on iDevices and MacBooks with better power/performance than comparable devices. Better still, these are devices that people will
still want when the petals fall off the AI tulip.
M2 Ultra is too slow to use cause Apple has no choice but to use their own chips other than Nvidia.
Nobody is claiming that the M2 Ultra Mac Pro is a good machine for AI training. It's not even
for that - it's mainly for users who beed specialist PCIe cards that
aren't GPUs/TPUs. There's already a M3 ultra and no reason not to think that there won't be a M4/M5 Ultra in due course. (There may be some cases where having 512GB of unified RAM directly accessible by CPU,GPU and NPU tips the balance - we'll see).
What you're really not getting is that AI
training can be completely separated from delivering AI services to users and there's really no downside for using (e.g.) NVIDIA hardware to develop models that are then delivered using Apple Silicon (which is
very good in terms of how much CPU/GPU/NPU power it can deliver on a mobile/laptop/small-form-factr device).
And I already told you, workstations are related to servers due to how they work in terms of part.
An iPhone is "related to" a server in many ways. The sort of video and image manipulation you can run on an iPhone would have been a "workstation" job not many years ago. You can stick Apache on a MacBook Air and use it as a "server". You can turn a Mac Pro (2019 or 2023) on its side, bolt it to a rack and run PostgreSQL on it and call it a server. Heck, some years ago Apple had a product called (questionably) a "Mac Mini Server" (it was just a Mac Mini with an extra hard drive).
So, here's your problem: You
can call something a "server" or "workstation" based on purely what you are using it for -
but that's not what people mean when they refer to hardware that bas been designed specifically for "server" or "workstation" use. I've got a couple of Raspberry Pis that I use as "servers" - but hardware-wise they're "maker boards" using chips designed for embedded systems or set-top boxes. .
AMD make "Threadripper" processors for workstations and "Epyc" processors for servers. Yes, they're "related", yes you
can run Davinci Resolve on an epyc, or SQL Server on a Threadripper - but the two products are optimised for different types of workload. Intel make half a dozen different Xeon ranges depending on whether you want a workstation (Xeon-W) or various types of server application. There's a bunch of other features that hardware
specifically designed as servers often have that you wouldn't find on workstations or personal computers: lights-out power management, redundant PSUs, hot-swappable drives, rack mounting etc.
If you're buying "pro" hardware to do a specific job, you pick the hardware optimised for the task at hand - you don't buy a "workstation" to use as a "server" or vice versa. In fact, "workstation" or "server" doesn't really cut it - do you want a 3D workstation, a scientific computing workstation, an AI development workstation, a file server, a database server, a cloud compute server...
This is partly why the Mac Pro is floundering. It's a one-size-fits-all platform aimed at customers with
specialist needs competing with the PC World which offers a vast range of interchangeable components (and several major operating systems) you can use to tailor a system to your exact needs. The 2019 Mac Pro priced-out anybody who just wanted a powerful desktop Mac - but only offered a very narrow range of supported CPU and GPU options c.f. the vast choice offered by PC hardware.