Apple removed nvidia support long ago so CUDA is a no-go on macOS for a long time.
Doesn't matter though. Professionals will buy hardware/tools to solve problems and get things done. And if that means they'll have to switch from macOS to Linux or Windows, that's what's going to happen as long as these platforms provide the necessary tools. Nvidia has a solution for pretty much everything, graphics, medical applications, robotics, physics, you name it, they have it. And it makes the job much, much easier. Everyone else has... a little tech demo in comparison. Apple fans are loyal, more than others. However, we're already seeing many people leaving Apple behind right now. I personally hate Windows with a passion, Linux is a must have in my field of research. Ever since G4 came out Apple delivered my primary drivers. Before I used Apple products dating back to around the mid 80s, I can't really remember. At this point I don't care anymore. I'm using my Macs for reading/writing, cutting a video here and there and Capture One for my photography work (hobby). If you would have asked me early 2020 that would ever happen, I would have told you hell no, not in a million years, yet here we are.
Wait, you've tried that? That requires Monetary to work.
You need 12.0+ for the tf-metal pluggabledevice. But tf-metal still requires you to use tf-mac which does not require 12.0. Base in this is still broken. One of my students used it... for a short amount of time... back to Ubuntu + Nvidia GPU.
I hope “Unleashed” does refer to intel as suggested earlier in this thread, because that would suggest AS replacements of all intel-based offerings. I’m tempering my expectations… but that would be a really cool event.
That would mean we'll see a new MacPro. Doubt that's going to happen unless the MacMini Pro is the new MacPro. And if that is the case, it'll be a new "trashcan", not upgradeable, no PCIe, etc. People won't be happy. I think the new MacPro will be introduced at WWDC next year with a fall release.
As the interest will rise, it is only a question of time until someone supplies a series of patches that make PyTorch and other tools play with Apple Silicon... hell, I would do it myself if I was invested in these frameworks.
Maintaining this stuff on your own is of course an option, but with the amount of tools required, plus porting results from other research groups, that means hiring people for maintenance work. To much work involved. It's easier to switch over to something else. Even if it would be Windows. I've been primarily on Linux for a little while now and surprisingly I'm not missing much. Sure, I have no DevonThink for syncing between iPads and macOS, I have no native Capture One, no Final Cut, no Bookends, I switched from Evernote to Joplin. I'm missing TexPad a little, as well as Highlights app and LiquidText. While Capture One / Final Cut remains on macOS, surprisingly I can get things done on Linux as well, everything. Sure, the email client and calendar don't look as nice as in macOS. And neither does working with Latex, but it works, no problem there. Again, we'll see what happens in the future. Until then people in these fields will switch, they might come back, or not. Time will tell.
The best that could happen to us would be full Linux support from Apple. Either in a VM or even better native with dual-boot. And with full, I mean eGPU support. How awesome would that be to have a powerful M-series chip, run Linux in a VM and a Nvidia GPU passed through to the VM. Hook up 3 or 4 monitors, two with Linux, two with macOS at the same time and boom, problem solved.
Grace is a super computer product, it will never be shipped in consumer devices. Or do you think Nvidia will be interested in building an ARM Linux laptop with a cut down Grace for data scientists? That sounds veeeery niche...
Scaled down of course. This thing will go into the next generation Jetson boards, so they might as well bring it to a laptop. Or just sell them to anyone to make their own products, which of course will run ARM Windows. If you break it down, Grace is a custom ARM CPU. So essentially Nvidia's version of the M-series chips. The difference is, they're willing to sell to Dell, Lenovo, HP and others for custom products. How good it will be, remains to be seen.