Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

rezwits

macrumors 6502a
Original poster
Jul 10, 2007
884
454
Las Vegas
NVIDIA DGX SPARK

I am looking at getting a MacStudio in the future to handle the likes of gpt-oss-120b-mlx-6Bit (96GB) etc models for private LLM or even larger models give or take in the future.

Now don't get me wrong, I understand that the DGX Spark would be way more optimized for AI and ML training if needed, but looking at the prices, it's interesting that:

A) The Spark is at 128GB unified (interesting huh?)
B) The Studio is at 96GB unified (each for the $3999)

That's sick that what small AI computing NPU Boxes are coming to.

I've read articles about multi-gpu boxes etc, but I have also read articles about, and have experience (a little), of GPU's dying in 6 months or 2-3 years on average.

I hate swapping GPUs etc

But this segment is interesting because it's like OK, 96-128 GB of RAM? $4000!

Now they have a higher costing model (not yet out) called the :

DGX Station (Blackwell Ultra / GB300 class) → The desktop big-memory beast.
  • Up to ~784 GB coherent memory (≈288 GB HBM3e GPU + 496 GB LPDDR5X CPU), NVLink-C2C up to 900 GB/s, ConnectX-8 up to 800 Gb/s.
But look at that memory...

I mean for a 512GB Unified, from Apple you are talking about $9500, but the Nvidia? Probably the same if not more, in price.

Now you guys can put all your little haha's (fanboy etc) you want cause I think Apple isn't looking to shabby. I only say this because of Unified Memory.
But also of the fact of this consumer level product. I mean you get macOS and you can use the damn thing for other stuff.

So from a consumer point of view that's pretty nice. (I mean I like my 40-120 VRR HDR! just as much as the next guy! hehe)
But I mean if you look what segments we have, it's: Gaming Rig <-> Development Rig <-> AnIMaL Rig.
Which we know yeah if we could have gaming on mac sure, but I mean gees, come on with the games we have iOS, I still would rather get a PS6!

But this will put Apple right smack dab in the MIDDLE, which I think is a PERFECT PLACE to BE!

I am running a Mac Mini M4 Pro with 64GB and getting really good results from a Qwen3-Next-80B-A3B-Instruct-MLX-4bit (45GB) in Xcode it's pretty nice:

Private, Free, works in Xcode! Get's a little crazy sometimes if not put on a leash, but still!

But man a MacStudio M5 Ultra? for say $4000 with 128GB? or even bump up to 256GB Unified? for $5600 ~ $6000?

That's not bad from Apple IMHO...

I mean to not be a 100% AI company and to have a "side project" Mac Studio that is right there?! in the mix of all this? AMAZING...

source: MEDIUM ARTICLE

 
What's you point? You post is all over the place, I'm not sure what you're asking/ranting/stating

The DGX Spark is a specific use type of computer deigned for AI. The Mac Studio is a general purpose computer that many of us use for many different tasks. Two different pieces of hardware for two different markets/customers
 
There's no point, I am not trying to prove anything! I am just giving notice about the DGX Spark, so people can see they have a similar MacStudio option if they want to go the NVIDIA route for AI or if they are considering the DGX Spark, it's 100% possible to go the MacStudio route...

How is that not obvious that I am plugging information about the DGX Spark? This is a apple/mac site, I mean?

Laters...
 
The Spark 128GB vs M4 Max Studio 128GB. For about the same price.

Pick your platform.

People buying Mac know they’re paying the Apple-tax for the upgrade (I know I did when I went all in on 128GB). Are people who don’t buy Mac prepared to pay that premium? Or would they rather spend that money on a dedicated Nvideo GPU? I suspect the latter.

The Spark just feels like they are playing catch-up to something Apple released 8 months ago.

Now, if the Spark had come out with 256GB RAM for ~£3,000 - £3,500? Then that would be something.

As it is, if you need 128GB RAM you now have your choice of platform. Take your pick. The other side isn’t going to tempt you away from that choice.
 
  • Like
Reactions: rezwits
Because Apple released a “128GB unified memory AI machine” 8 months ago. The Spark should have jumped that with 256GB, not matched it.
The Studio? That's not an AI machine, but a general use computer that can also do AI - provided you spec it out sufficiently. Where as the spark is an AI machine - it does one thing and one thing only, and as such it doesn't have to contend with the overhead of a full blown operating system.

I'm not saying that the Studio is ill fitting for AI tasks, or buying the studio instead of the Spark is a poor decision.

As for the Spark, So far, I've only seen positive remarks, reviews, and YTs tbh, I don't recall anyone saying that nvidia is playing catchup, quite the opposite they're leading the charge in AI and this is but one piece in the puzzle
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.