Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Other than LLMs, what does one need 512gb of ram for?!

I just pulled up the remote desktop on a remote server here at work that handles pharamcy operations 5 hospitals, and it's only 64gb.
There are definitely engineering uses for machines with lots of memory but really the main reason so many people are buying them is personal LLM work.

Apple just broke open a huge new market.
 
  • Like
Reactions: Allen_Wentz
OR, hear me out, someone is actually making MONEY with his computer so he buys it on credit or pays for it as a business expense with business savings. I know, absolutely wild idea 😁
Either making money or getting a research grant. You don't need 512 GB RAM for video. Maybe for AI research.

I have not worked out the costs but the studio loaded with RAM might be cost-effective compared to the PC with comparable VRAM.

This is what people forget. When you compare the cost of RAM in a Mac to the cost of RAM in a PC, you have to remember that all of the Mac's RAM can be used as Video-RAM. What would you have to pay for a Nviidia GPU card that had 512GB VRAM?

Does anyone need 512GB of VRAM? Yes, try running 200 billion parameter LLM on your 16GB GPU card. It is going to be slow.
 
  • Like
Reactions: neuropsychguy
I'm curious how many of these end up in landfills after the warranty expired and there is an issue that requires a logic board replacement...

That's the sad part of soldered on components.
 
Either making money or getting a research grant. You don't need 512 GB RAM for video. Maybe for AI research.

I have not worked out the costs but the studio loaded with RAM might be cost-effective compared to the PC with comparable VRAM.

This is what people forget. When you compare the cost of RAM in a Mac to the cost of RAM in a PC, you have to remember that all of the Mac's RAM can be used as Video-RAM. What would you have to pay for a Nviidia GPU card that had 512GB VRAM?

Does anyone need 512GB of VRAM? Yes, try running 200 billion parameter LLM on your 16GB GPU card. It is going to be slow.
Yes. Apple create someting unique. To be in a similar ballpark with VRAM with Nvidia/AMD you would need to speed 5-10x more.
 
  • Like
Reactions: mozumder
You clearly don’t understand who this beast was designed for. It is not for some Richie Rich to play with. It’s for professionals who need such specs for their work flow. You know, like video editing professionals, scientists who need extreme number crunching power, AI and the like.

Why the snark when you are apparently clueless about the usefulness of such a machine?
No video editing professional needs 0.5TB of RAM.
 
I'm curious how many of these end up in landfills after the warranty expired and there is an issue that requires a logic board replacement...

That's the sad part of soldered on components.
In my case, none.

I've had Macs (desktops + laptops) since the 512ke, and none of them have died due to a logic board problem.

I've had a few iPhones die, though.

Hating on soldered on components is fashionable, but pointless.
 
I'm curious how many of these end up in landfills after the warranty expired and there is an issue that requires a logic board replacement...

That's the sad part of soldered on components.
Most electronics (except audio) end up there after a few years, no matter how they are built. Technological advancements push them there. Tons of Nokia phones are there too, even though they had replaceable batteries, memory cards, replaceable casings and simple construction.
 
In my case, none.

I've had Macs (desktops + laptops) since the 512ke, and none of them have died due to a logic board problem.

I've had a few iPhones die, though.

Hating on soldered on components is fashionable, but pointless.
Yeah in my personal cases none either, but at work over 25 years we've had many G3/G4, iMacs, Mac Pro's (cheesegraters) that needed logic board replacements, ram replacements, cpu board replacements in mac pro's etc...

Sometimes they were worth fixing, other times not post warranty. I'm just saying that nobody is going to fix one of these maxed out M3 Ultra's after warranty is expired let's say in 5 years, because even if the logic board is available in that configuration, it will probably cost $10k+.
 
Yeah in my personal cases none either, but at work over 25 years we've had many G3/G4, iMacs, Mac Pro's (cheesegraters) that needed logic board replacements, ram replacements, cpu board replacements in mac pro's etc...

Sometimes they were worth fixing, other times not post warranty. I'm just saying that nobody is going to fix one of these maxed out M3 Ultra's after warranty is expired let's say in 5 years, because even if the logic board is available in that configuration, it will probably cost $10k+.

I suspect they end up in the secondary market and with people that know how repair soldered logicboards. There are people and companies, currently, that will upgrade the SSD and ram on the current M-series Macbook Airs and Pros.

Despite everything being soldered, there are people who know how to fix such things and have the equipment to do it.
 
I suspect they end up in the secondary market and with people that know how repair soldered logicboards. There are people and companies, currently, that will upgrade the SSD and ram on the current M-series Macbook Airs and Pros.

Despite everything being soldered, there are people who know how to fix such things and have the equipment to do it.
SSD upgrades are one thing, but are people doing ram upgrades on high value Max/Ultra chips? Are these high density ram chips available to buy?
 
SSD upgrades are one thing, but are people doing ram upgrades on high value Max/Ultra chips? Are these high density ram chips available to buy?

I don't know, I just suspect that with such a high-value system, that is what will happen.

I was looking into having my M1 Air upgraded to 2tb (from 512gb), but decided against it after seeing the cost.
 
You clearly don’t understand who this beast was designed for. It is not for some Richie Rich to play with. It’s for professionals who need such specs for their work flow. You know, like video editing professionals, scientists who need extreme number crunching power, AI and the like.

Why the snark when you are apparently clueless about the usefulness of such a machine?
Data crunching and AI would require something way more powerful than this, and at cheaper cost.

That’s what data centers and related services or servers at companies and universities are for. This is a desktop
 
The versions with 512Gb RAM and 1-4Tb SSD are cheap for running LLMs locally.
 
Last edited:
You clearly don’t understand who this beast was designed for. It is not for some Richie Rich to play with. It’s for professionals who need such specs for their work flow. You know, like video editing professionals, scientists who need extreme number crunching power, AI and the like.
He was being light-hearted, jeez. Anyway, only 1 of these 3 groups you've cited actually requires this level of spec. And as for AI being "useful" currently, well that is highly debatable.

Me? I'm not paying 14 grand for anything unless it's got "Pro" in the name [/s] 🤪
 
I was planning to buy my first Mac Studio but I don’t want to spend all that money on 3 year old Apple displays to go with it.

If you’re an existing user it probably doesn’t make any difference but time and again Tim Cook seems to completely forget about new users who need a complete package not half now and the other half in a year. I will be very happy when Cook is gone.
The first bold resonates with me, the ASD is already expensive and I wish LG didn't discontinue the 4K 21" UltraFine since that would be enough for me. The second bold, what are the current Apple display offerings missing for you as far as release timing? These new Mac Studios have TB5, are you wanting ProMotion or something to go with?
 
I was planning to buy my first Mac Studio but I don’t want to spend all that money on 3 year old Apple displays to go with it.
Then buy a Mac mini.

Honestly, the Studio Display (especially in nano-texture form) is gorgeous if annoyingly pricey. These days, you're more likely to upgrade your Mac more frequently than your display. Disagree? Ask owners of i7 Intel 27" iMacs with their 5k displays now rendered pretty much obsolete.
 
I was looking into having my M1 Air upgraded to 2tb (from 512gb), but decided against it after seeing the cost.
And just think how easy and cheap it would have been if Apple simply used a removable module, a standard size NVMe.

They are as small as postage stamps now (2230's). They've shown the can do this in the latest Mac Mini, while still proprietary, it can be done.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.