Just 18 months ago, people were saying “there‘s no way a phone chip is going to compete with Intel….a phone chip can’t handle PC workloads!”
The huge problem with that analogy is that Apple had a Personal Computer product and Personal Computer operating system. Apple was in that market, but just using Intel only a the CPU package.
Apple killed off their specific server hardware long ago. The 2019 Mac Pro rackmount is just an inexpensive 90 rotation of the PC tower box they sell. It is not rack hostile ( handles and feet sitting way out when in the horizontal position), but it is not server density optimized at all. For what it is ( number of internal drives and CPU core count) it is relatively huge.
Apple has been choking "macOS Server" to death for years on the software side.
If if Apple has zero interest in this space for their own products, how are they going to come out with an amazingly competitive Server SoC for other people????? That is the huge gap here.
Apple was interested in dumping Intel. Apple was Intel only buyer and Intel was stumbling badly. Why wouldn't they be interested in getting off? In 2016-2018 AMD wouldn't have looked like an option. ( maybe they are stopping shooting themselves in the foot or maybe not).
And here we are….most mainstream websites and video channels comparing a phone chip against i9’s and RTX30xx series - hilarious.
The plain M1 ( and others with suffixes) are not a phone chip. If put an M1 in a phone it would fail. Likewise if put an M1 in a PC tower ... it would also be a fail ( 3-4 x1 PCI-e v4 lanes isn't going to cut it).
The laptop i9's and RTX 30xx are the main comparisons.
Macs sold by Apple are 70+ % laptops and that's mainly what done with the M1-M2 series; build laptop competitive SoCs.
Where someone has been using Intel Minis to do small-business/home/department-level server duties then the M1/M2 Mini (and hopefully M2 Pro) will do just fine. However, hat is really mutating the connotation of "server" this thread started off with.
Apple has said several times where they think they can do a much better job than the current component makers then they'll consider replacing it with something of their own. In the "big iron" server SoC space where is the huge fail going on if put all of the options on the table? Apple's data center is chock full of Linux servers that run just fine on top of AMD or Ampere Compute SoCs also if Apple wanted to go that way. The Mac SoC are missing gobs of features necessary (so not current vendors are not messing up there either). So how is Apple doing a much better job than the alternatives?
Xcode Cloud is not the more inexpensively priced possible cloud service either. At the price point Apple is using it can be run just fine using off the shelf Macs as the system components. The bulk of the rest of their set up is not macOS at all so what does a macOS SoC buy there? Not much.
Apple has largely saddled the currently transitioned Mac desktops with laptop SoCs : mini - M1 , iMac - M1 , Studio (iMac 27" replacement) - Max. The Ultra takes the highly constrained but far cheaper to make path of just being two Max dies glue together. So the dual edged sword on that is that is assumes much of the laptop design constraints also. The Mini should get the M2 Pro as an alternative.
So Apple hasn't really done anything even PC desktop/workstation specific yet. The Mac Pro SoC is missing, but if it just incrementally moves the constraint needle to just mainstream "desktop" features , then there still won't be a true medium-large scale server offering.
If Apple took the MP 2019 logic board and made changes to drop in a AMD Threadripper WX 5000 and previous out the I/O from that it would be an across the board uplift in CPU performance and I/O . Not sure where the component vendors are 'failing' them there. ( Yes , pragmatically stuck with only Intel since transitioning away from x86-64 ). The WX5000 outstrips macOS thread limit. The PCI-e I/O is better match to current and next years GPUs . RAM capacity limits are cheaper to get to. etc. etc.
That is probably not where the next Mac Pro is going. It is probably going to be something with constraints that Apple throws at the Mac Pro their SoC will be the "better fit" SoC. More Mac specific constraints (as opposed to server oriented ones). Some of the features of the Intel Xeon W-3200 and WX 5000 are because of silicon reuse that Intel/AMD weaved into the product for maximized server die reuse . Some features tricked into the MP 2019 was highly coupled to the W-3200 and because Intel thought to include them. Apple leverage the features in the marketing of the product that used that CPU package, but were not necessary inherently huge fans of all the features. ( Intel laptop and desktop CPU provision 8-20 PCI-e lanes and Apple does x4 (and a niche kind of x8 they don't fully use). )
Apple has done backsliding on RAM capacity , I/O, number of displays driven , etc. on the current set of M-series offerings. With respect to those characteristics the M1 series is much closer to being a "phone chip". There is more to generally good system design than Geekbench and synthetic offscreen GPU scores. Even more so in the server space.