macfacts
macrumors 603
how can they when their unified fast memory depends on a single location for the memory.debatable as to if they'd ever go for a separate card,
how can they when their unified fast memory depends on a single location for the memory.debatable as to if they'd ever go for a separate card,
The OP is postulating that the apple needs a mac pro computer in the line up, and my question pertains to that. Apple is not returning to x86, so a comparison to xeon/threadripper only makes sense imo, is that apple comes out an Extreme version of the apple silicon which they were rumored to have been working on a few years ago, and that silicon has an architecture more suited for workstation usage.I think a better question is what does a Xeon/Threadripper do that an Ultra does not. And the answer is PCIe lanes and other forms of external connectivity.
This is wrong on so many levels it will take a day to explain. How much GPU RAM does 4070 or 5090 support compared to Apple silicon Mac Studio? Apple isn’t going to go after high end Nvidia data center chips. It’s well placed in the workstation place that needs lot of GPU memory. And if Apple does need to compete in workstation markets, 5090 or even 4070 are’nt really workstation class GPUs according to Nvidia.They are. ECC RAM, workstation GPU, Xeon CPU are great examples. Servers are just a bigger version of workstations with more parts.
Apple Silicon chips cant provide faster GPU like RTX 5090 or workstation GPU. Are you gonna say Apple is the best even if 4070TI is what they can do at max? Dont forget how much cheaper is 4070TI compared to Mac Studio with Ultra.
So wrong.This is wrong on so many levels it will take a day to explain. How much GPU RAM does 4070 or 5090 support compared to Apple silicon Mac Studio? Apple isn’t going to go after high end Nvidia data center chips. It’s well placed in the workstation place that needs lot of GPU memory. And if Apple does need to compete in workstation markets, 5090 or even 4070 are’nt really workstation class GPUs according to Nvidia.
Do Disney still use Mac Pros?Tell that to Disney and it only proves that Mac is too limited to use because of GPU performance. You literally admitted that Mac's GPU performance sucks after all.
No, they dont. After the transition and Mac Pro 2023, they no longer use them.Do Disney still use Mac Pros?
So wrongSo wrong.
GPU uses VRAM, not RAM. While it is an advantage over PC, does it really gives advantage for workstation?
Storage extension is a big plus for Mac Pro if you need high end local storage. But then AMD intel provide more bang for the buck if storage is main criteria.I think a better question is what does a Xeon/Threadripper do that an Ultra does not. And the answer is PCIe lanes and other forms of external connectivity.
As far as I know, the Max has roughly the same external bandwidth as Intel/AMD consumer chips, and the Ultra has twice as much. (But I haven't seen concrete numbers for the recent chips.) That means the Ultra has around half the bandwidth of a proper workstation chip. If you have a setup with multiple high-resolution monitors, a lot of local storage, and a fast network, a Mac Studio may run out of bandwidth before a proper workstation.
carry on! Ignorance is bliss. Good luck running models that need more than 32 GB on GPU. 5090x is useless when it runs out of memory.So wrong.
GPU uses VRAM, not RAM. While it is an advantage over PC, does it really gives advantage for workstation? No. Besides, despite having a lot of space, the bandwidth is slower than RTX high-end GPU and workstations. The space is not everything.
How does Mac Studio compare to RTX 5090? It only performs up to RTX 4070TI mate. By your logic, how will it replace workstations when the GPU level isn't even near RTX 5090? How ironic.
You have lot more patience than me. With unified memory it doesn’t really matter as they are becoming interchangeable.So wrong
There's a number of GPUs that use dram, including apple. Also people can use the term ram, to mean either dram, or vram, depending on the context. You missed that, I guess
View attachment 2583169r
There are many tasks for GPU and yet, you only picked LLM and then say Apple is the best. Since when Apple is well known for AI? Ironic.Storage extension is a big plus for Mac Pro if you need high end local storage. But then AMD intel provide more bang for the buck if storage is main criteria.
carry on! Ignorance is bliss. Good luck running models that need more than 32 GB on GPU. 5090x is useless when it runs out of memory.
Unfortunately there are no mid tier workstation solutions, and Nvidia gets crazy expensive as you start pushing higher memory requirements. I wanted to like spark, but it is like a beta product. Mac Pro is not gonna make AS faster at fp8.
That’s your problem, I don’t even use it for LLMs. If you wnat to run LLM they are much cheaper cloud options than blowing money on Apple silicon or Nvidia.There are many tasks for GPU and yet, you only picked LLM and then say Apple is the best. Since when Apple is well known for AI? Ironic.
If so, why not make Mac Pro then? You are justifying the current situation as if 512GB is the biggest that LLM can go. You logically failed.That’s your problem, I don’t even use it for LLMs. If you wnat to run LLM they are much cheaper cloud options than blowing money on Apple silicon or Nvidia.
I asked this already, what can a mac pro do that the studio cannot? You cannot use discrete GPUs, there's no NVMe expansion with apple silicon, no ram upgrades.If so, why not make Mac Pro then?
I don’t care about LLM. Not sure what logic you are talking, it makes no sense when LLM is not even in the conversation nor I use them on MBP. Mac Pro outside of extending storage or additional Video cards isn’t any different than Mac Studio. honestly that market has moved on long time ago. My last Mac Pro was 2012, trash can might have just killed Mac Pro.If so, why not make Mac Pro then? You are justifying the current situation as if 512GB is the biggest that LLM can go. You logically failed.
I'm pretty sure we've been under mind control ever since 1984.The real question is will Apple release an MK Ultra version?
I think one has to see the bigger picture here.They are not really treating the Mac Studio that well either. Even if I could get behind the idea that not all generations will have an Ultra variant, simply waiting until M4 was released was a majorly bad decision. M4 Max vs M3 Ultra is a ridiculous combination. And why didn't they make the M3 Ultra when M3 Max was out?
If Apple's chip team is not up to the task, then please just move back to x86. Intel and AMD still beat the socks off of a maxed M3 Ultra Mac Studio at a fraction of the cost. And with the economy the way it is going, MANY people will not drop $2,000+ for a system anymore let alone $6,000+.
A same story for others making workstations so not a good excuse.Mac Pro is a retail product for the retail channel. It doesn't sell well, so it won't be updated. That has nothing to do with their chip plans or what they design for their own internal use needs. If they need to make faster chips to keep up with AI, then they will need to do that. But having a poor-selling retail product to take up inventory space in a warehouse isn't going to drive innovation--the needs of the demanding AI will. Having a product that only gets updated every few years is actually a hinderance to innovation. Why make something better when you have a stockpile of perfectly decent ones that you haven't sold through yet? Things like the iPad Pro or Macbook Air/Pro, which get revised every single year, keep the pace of those improvements much higher than the Mac Pro ever could.
Although I agree with what you are saying conceptually, your argument fails to make sense.Mac Pro is a retail product for the retail channel. It doesn't sell well, so it won't be updated. That has nothing to do with their chip plans or what they design for their own internal use needs. If they need to make faster chips to keep up with AI, then they will need to do that. But having a poor-selling retail product to take up inventory space in a warehouse isn't going to drive innovation--the needs of the demanding AI will. Having a product that only gets updated every few years is actually a hinderance to innovation. Why make something better when you have a stockpile of perfectly decent ones that you haven't sold through yet? Things like the iPad Pro or Macbook Air/Pro, which get revised every single year, keep the pace of those improvements much higher than the Mac Pro ever could.
There’s still a VERY prevalent lack of understanding as to how Apple Silicon is different from an Intel or AMD or Nvidia solution. As a result, you’ll still get folks assuming that a discrete solution (over a bus FAR slower than what Apple uses currently) would yield better performance.how can they when their unified fast memory depends on a single location for the memory.
Yup. Plus the extra clock cycles required in the AMD, etc. solutions.There’s still a VERY prevalent lack of understanding as to how Apple Silicon is different from an Intel or AMD or Nvidia solution. As a result, you’ll still get folks assuming that a discrete solution (over a bus FAR slower than what Apple uses currently) would yield better performance.
That's a bold statement, so if local LLMs aren't feasible on Apple Silicon, you're saying that it (apple silicon) will largely fail and be cast aside?all of Apple's chips will be made obsolete