Well, in the the end it does come down to raw performance. Although, and I do agree on that, it isn't just a single area Apple currently has an advantage.
M1 uses a lot of the silicon budget for on-die cache - 24 megabytes total. For 4 performance cores. AMD has 32 Megabyte for 8 cores - which then also do SMT. The decoders of the performance cores are 8-wide, which, even if it's "just" a RISC architecture, is a lot of logic, and then there is the unheard of 600+ instruction deep reorder buffer, which, again, even for a true RISC architecture, is outright insane.
Then, M1, especially Pro, Max and Ultra, uses incredibly expensive memory on a very wide bus at very low latency. Apple Silicon Macs, again especially the Pro, Max and Ultra variants, use very expensive, very fast flash storage with incredibly high IOPS, and something equivalent to PCIe4 x4 throughput (probably it's exactly that) on some custom controller hardware - which again isn't cheap.
Finally: Apple still is a whole node ahead of everyone else - at least until AMDs Zen 4 chips become available, but by that time Apple will have moved to N4, so they are still at least half a node ahead. Apple pays top dollar at TSMC for their advantage. And I'm pretty sure the initial plan for A16 and M2 was to go N3 this year, which would have meant again a full node ahead of everyone else.
All of this is very expensive. Apple does a lot of very expensive things to gain relatively small advantages which do compound into quite an impressive package. If that justifies the prices Apple puts on SSD and RAM upgrades we can very much debate. But Apple has pretty much done the opposite of what AMD and intel have been doing for quite some time: rigorously focus on single thread performance and high level integration at the cost of scalability, modularity and, well, cost.
Bottom line the M1 Macs are the most no-fs-given consumer computer design we've seen in quite a long while. Nothing here is this way or that way because Apple actually wants to sell server CPUs. And while Apple will very much make a very healthy profit on them, at least now you get something for your boutique prices. Because Apple clearly could sell a much less impressive package with much higher profit margins, and people would still buy it. So .... without singing the Tim Apple praises too much .... the kind of splash the new ARM Macs made is absolutely justified.