Apple has shown zero interest in High Performance Computing. Even the 2019 Mac Pro only offered a single CPU and dual GPUs which made it at best a mid-tier workstation.
Apple Silicon is very much not designed for HPC as it prioritizes power and thermal efficiency over raw performance. We have seen it has issues effectively scaling past a couple dozen CPU cores and a few score GPU cores (the Ultra). But for the intended markets, it's performance is exceptional and it delivers that performance with class-leading efficiency.
As others have tried to explain, the lack of software drivers is not the issue - Apple Silicon is believed to lack the hardware to interface with external GPUs and one may very well have to completely re-design the SoC to add that functionality.
I think it depends on which definition of HPC you use. HPC as in cluster-level performance? That is certainly not something Apple is interested in. But HPC at a personal computer level, I would say that they are very much interested in that. I mean, so far they are the only mainstream CPU designer that ship advanced high-throughput vector and matrix hardware on all levels of consumer products.