I am just starting to develop and run some AI software using the M2-Pro. In the past, this was exclusively done using Linux on Intel with Nvidia GPUs. So far the move to M2-Pro is going OK.
I will consider upgrading the M2-Pro after two things happen
1) I am convinced the move from Linux/Nvidia will work for larger AI models and
2) I am convinced the upgrade would make a qualitative difference in what I can do, not just an incremental speed bump. I would need to be able to do something I can't do now.
In my case, I need two things to make #2 happen first much faster GPUs or many more GPU cores. And at least a doubling of performance but > 4X would be more compelling. and I'd also need much more RAM. I'm finding that 16GB is enough to run a speech to text model and a 7 billion parameter LLM at the same time with good-enough performance. I was surprized this works so well. But I am using C++ and "metal" on the M2-Pro.
I will wait and see if there is an M4-powered Mac Studio with at least 32GB of ram or perhaps 64GB. But there is no reason to upgrade until my software is limited by the current hardware and that is not yet the case. Today my progress is limited by my brain-power. I've not yet run into a hardware limit.
It might be the case that I don't hit a true hardware limit until the M6 is out and who knows if by them Linux and Nvidia might be well out in front again.