Adding more cores only does so much depending on what is being run on the computer, how the OS is managing the processes, and how the chip is managing the cores.
...true, but true for the competition as well - the higher-end Core i, Xeon-W, Ryzen etc. models are mainly differentiated by having more-of-the-same cores, and that partly applies to high-end GPUs as well, so it's not as if Apple are going out on a limb with multi-core. Squeezing an extra 20% single-thread performance out of a core is hard c.f. doubling the number of cores. Optimising software to exploit those multiple cores can also be hard
but the payoff is that using double the number of cores can nearly double the performance on suitable tasks. Audio, video, scientific computing etc. workloads tend to be amenable to multi-core processing and represent a huge market - I'm sure there's a 'niche' for super-powerful individual cores but it probably
is a niche.
A few people here still talking about M-series power per watt being a consideration. Sad truth is away from mobile systems like laptops and iPads/iPhones literally no one cares about that.
I agree that power efficiency is nothing like the night-and-day advantage you see in mobile/laptop applications.
However, it still
is a consideration - look at how much space and expensive engineering there is in the Mac Pro just to handle power supply and cooling, mainly for the CPU and graphics cards. Electricity bills for data centres can be a big deal too - you pay for the electricity to run the computers, the computers turn the electricity into heat, then you pay
again for the electricity to run the air conditioning to get rid of that heat...
Problem is the 2019 Mac Pro concept sits pretty much at the point where power consumption is
least important: a stand-alone workstation that has to be big enough to physically hold 8 full-size PCIe cards on one hand, and isn't really suitable for data centre or high-density computing use on the other. A like-for-like replacement of the current Mac Pro never going to be the best showcase for Apple Silicon.
What we know so far is M-series devices have a very walled-off architecture with virtually no opportunity to upgrade literally anything, and even if Apple put a gate in the wall, currently nothing out there is compatible. All that is going to have to change.
The upgrade path for the M1 range is to add more M1s - either on-chip (M1 Pro/Max) on-package (the rumoured x2 and x4 versions) or just by adding more packages. Also, unlike some of Apple's Intel offerings, ir's not just locked down for the sake of it, it's reaping performance benefits by combining everything in a single package.
On top of that, the x2 and x4 are likely to have a shedload of TB4 ports.
Plus, the M1 does appear to have PCIe (the 24" iMac uses a PCIe-to-ethernet chip, for starters) which presumably means the number of available lanes gets scaled up with the larger versions. I doubt that it can match the Xeon-W for PCIe lanes but then, if PCIe GPUs aren't going to be supported, it won't be using 16 or more lanes just for a GPU. So it is down to Apple whether or not to have PCIe slots.
However, making a bad 2019 Mac Pro clone probably wouldn't be a good use of Apple Silicon. Instead, they could make a
good trashcan replacement (ideal for all those YouTubers producing prosumer videos) and/or some sort of blade system that could take multiple M1-based compute modules. Meanwhile - unlike in 2012 - they've got a fairly up-to-date 'conventional' Intel Mac Pro for the customers that really need it.
Only Apple know how well the 2019 Mac Pro has been selling, and how much cost/effort is justified in keeping it going. The cost of supporting the Intel Mac Pro for another few years, while simultaneously exploring more radical options using multiple M1s could be a better option than sinking a lot of money into trying to make an Apple Silicon-based Xeon killer chip that would only ever have a tiny market.