He didn't, but I do. I wouldn't support that claim for a decently conservative Linux install.Does he even say Windows? He says "other systems" or did I miss something?
He didn't, but I do. I wouldn't support that claim for a decently conservative Linux install.Does he even say Windows? He says "other systems" or did I miss something?
The machines that don’t exist? Yea I agree they don’t cost that much. Seen razer blade 16? With a 4070ti it is exactly $4000 with a warranty. Seen that g14 with 4090 yep $3200. Seen them Lenovos or alienwares yea. I rest. They are over $3000 for a nice machine. Sure you can get one cheaper with lesser specs but again nobody is putting a 4080 with a 15 watt cpu.They don't cost $3k-4k....
Yeah, for a component that actually costs them sweet FA, regardless of the price they ream us to high hell with.Or they can stop being petty and make 16 the base.
Or Safari developers. Safari isn't any better in this respect.tell that to Chrome developers
Uh that is now like a 50w cpu, but anyway…The machines that don’t exist? Yea I agree they don’t cost that much. Seen razer blade 16? With a 4070ti it is exactly $4000 with a warranty. Seen that g14 with 4090 yep $3200. Seen them Lenovos or alienwares yea. I rest. They are over $3000 for a nice machine. Sure you can get one cheaper with lesser specs but again nobody is putting a 4080 with a 15 watt cpu.
To be honest, even that would be a more ideal solution than leaving 8GB on the base model IMO. A lot of retailers don't stock the RAM-upgraded models (some do, some don't), and people in other countries especially apparently have a lot more difficulty with this if they aren't near an Apple store and don't want to wait for a build-to-order.Given Apple’s past actions, they’d jack up the base price by $200, so that M3 16/512 would cost $1799 instead of $1599 and they’d simply drop the 8GB version. They did that for the iPhone 15 Pro Max and they probably did it for the base M3 MacBook Pro anyway when they upped the base version to 512GB from the M2 13” MBP’s 256GB base. If they had kept 256GB as the base for the 14” M3 MBP, they likely would have charged $1399. They tossed in the chassis and all the goodies you get from a higher MBP (MagSafe, ports, screen, speakers) just to assuage criticism for the price hike, and yes it was a price hike since that model replaces the 13” MBP. They called it a lower base price from the M2 Pro’s $1999 price, but that’s what marketing does.
That they will just bake a price hike into the base price is why I oppose changing the base configuration to 16GB because Apple would make it more expensive for the people who don’t need 16GB. Apple is not going to just toss it in for free. If Apple were to miraculously make the next model 16GB base without raising the price, I’d be all for it. Nobody opposes the concept of more memory, but we don’t want anyone to pay for what they don’t need. But until their market research tells them that people don’t want 8GB anymore as their base, they’re going to continue offering the same amount. Loud voices on tech chat forums aren’t going to change their mind. Only supply and demand will dictate that. The market speaks. Most people are just fine with 8GB.
I think it's time for 8GB computers to just die across the board. The Air should start at 12GB min and the Pro at 16GB or 24GB since they are embracing the odd sizes now.To be honest, even that would be a more ideal solution than leaving 8GB on the base model IMO. A lot of retailers don't stock the RAM-upgraded models (some do, some don't), and people in other countries especially apparently have a lot more difficulty with this if they aren't near an Apple store and don't want to wait for a build-to-order.
Furthermore, the models that go on deep sales at retailers are often the base models, and if the base model is a higher specced machine, there would be opportunities for people to get it at a lower price when these sales happen.
Still not saying it's ideal (in my opinion, 16GB should come standard once we're talking about $1600 price brackets).
No one has ever said that 16GB wouldn’t work better for many users. Obviously, the more the better. 64GB would work great for almost all users, but very few want to pay for that much. The question is whether 8GB is enough for a lot of users. Not all, but some. That ”some” has to be numerous enough for computer makers to sell 8GB as their base systems. The answer, according to the entire computer industry, is a resounding yes since everybody sells 8GB systems. If it weren’t, nobody would be selling 8GB computers, yet all of them do. Over time, 4GB base was phased out for 8GB. When the time comes, 8GB will be phased out, too, but that time apparently isn’t now. For that subset of users that get along fine with 8GB, they will buy the base units and will be quite happy with them.Some have questioned if people have even owned a silicon...we have...about 80 units of the m1 iMac's in service, and yes its a great machine and a great introduction to Mac silicon, but its a fallacy to suggest they don't work better with 16Gb for many users. We kept clear of M2,as I didn't believe they would surpass the M1 by sufficient to warrant economical replacement, and with regards M3, I won't be upgrading the base iMacs at 8Gb or paying for the 8Gb upgrade, in some way because of the success of the original iMac M1, and as ever there's always another chip around the corner, and yes the M1 exceeded our expectations, both for our internal use and for our customers.
Nothing you’ve said contradicts anything I’ve said, except for a few minor errors you’ve made. I still don’t know what you disagree with me about. You keep telling me things I already know, implying you’re disagreeing with me about something. They have no intention of exposing any of it to developers. They specifically said it was entirely done in hardware so no OS nor developer implementation is needed. The entire mechanism is “transparent” to developers. The whole logic is probably done in the memory controller. BTW, there is no system RAM. When someone says system RAM, that is defined as the standard memory available to the CPU, also implying there is dedicated graphics memory, which there isn’t. In the case of the M-series of chips, the unified memory is used by both the CPU and GPU. The GPU (or CPU) makes RAM requests to the MMU and the MMU allocates and deallocates accordingly.
Sure, lots of computers come with 8GB RAM, but then those computers don't cost $1,600 (USA) or up to $2,200 in some parts of the world. For that price you expect better than "sufficient", don't you?No one has ever said that 16GB wouldn’t work better for many users. Obviously, the more the better. 64GB would work great for almost all users, but very few want to pay for that much. The question is whether 8GB is enough for a lot of users. Not all, but some. That ”some” has to be numerous enough for computer makers to sell 8GB as their base systems. The answer, according to the entire computer industry, is a resounding yes since everybody sells 8GB systems. If it weren’t, nobody would be selling 8GB computers, yet all of them do. Over time, 4GB base was phased out for 8GB. When the time comes, 8GB will be phased out, too, but that time apparently isn’t now. For that subset of users that get along fine with 8GB, they will buy the base units and will be quite happy with them.
For everyone else, we either have to buy configurations that start with more power and more RAM or we simply upgrade the base RAM. A significant problem I have with many people wanting free RAM is that they consider their needs are everyone else’s needs, too, and can’t imagine anyone needing less. The end result is people who don’t need that much having to pay for stuff they don’t need. I don’t trust Apple (or any other company) enough to think they would provide free RAM out of the goodness of their heart. Inevitably, and it’s been proven time and time again, when they boost base specs, they also boost the price.
Interesting read. This goes beyond what I had originally thought, but it actually does what I said it would do and then some. In traditional GPU’s, memory is allocated and kept track of by registers that maintain a list of memory pages allocated for that process. That can lead to two things: 1) the GPU bottlenecks when it runs out of registers to track memory pages, and 2) it is forced to allocate a larger amount of memory than would be needed for the immediate request. My theory address the second, while the first was not something mentioned at the event, but answers a question many of us had.Commenting on our earlier conversation. Apple has now released a tech note explaining what Dynamic Caching is and how it works in great detail. I hope this will end the baseless speculation that this feature has anything to do with system DRAM. You can find the video here:
![]()
Explore GPU advancements in M3 and A17 Pro - Tech Talks - Videos - Apple Developer
Learn how Dynamic Caching, the next-generation shader core, hardware-accelerated ray tracing, and hardware-accelerated mesh shading of...developer.apple.com
There is little I disagree about your post albeit I still believe it would be in Apple's best interests to have a 16Gb base configuration at very little cost, and where I suspect that would be self financing by removing production of the 8Gb base and where its own aspirations are heading into more services including games, where 16Gb would not only assist, but could put multiple industry critics back on side, many complaining about 8Gb especially for a range with 'pro' in it. It won't stop others with greater needs buying more RAM, and the devices geared towards heavier usage already have a higher base configurations which Apple must consider a necessity.No one has ever said that 16GB wouldn’t work better for many users. Obviously, the more the better. 64GB would work great for almost all users, but very few want to pay for that much. The question is whether 8GB is enough for a lot of users. Not all, but some. That ”some” has to be numerous enough for computer makers to sell 8GB as their base systems. The answer, according to the entire computer industry, is a resounding yes since everybody sells 8GB systems. If it weren’t, nobody would be selling 8GB computers, yet all of them do. Over time, 4GB base was phased out for 8GB. When the time comes, 8GB will be phased out, too, but that time apparently isn’t now. For that subset of users that get along fine with 8GB, they will buy the base units and will be quite happy with them.
For everyone else, we either have to buy configurations that start with more power and more RAM or we simply upgrade the base RAM. A significant problem I have with many people wanting free RAM is that they consider their needs are everyone else’s needs, too, and can’t imagine anyone needing less. The end result is people who don’t need that much having to pay for stuff they don’t need. I don’t trust Apple (or any other company) enough to think they would provide free RAM out of the goodness of their heart. Inevitably, and it’s been proven time and time again, when they boost base specs, they also boost the price.
Interesting read. This goes beyond what I had originally thought, but it actually does what I said it would do and then some. In traditional GPU’s, memory is allocated and kept track of by registers that maintain a list of memory pages allocated for that process. That can lead to two things: 1) the GPU bottlenecks when it runs out of registers to track memory pages, and 2) it is forced to allocate a larger amount of memory than would be needed for the immediate request. My theory address the second, while the first was not something mentioned at the event, but answers a question many of us had.
I didn’t say the GPU allocates memory. It requests the memory, which is then supplied to it. You’ve almost got it. You got that unified memory means the CPU and GPU share the same memory, but somehow take that concept and miss its application. When the GPU is able to finish with its tasks quicker, allowing the memory to be released, that extra memory is freed up for the CPU to use because they share the same space. You would be correct only if the GPU had its own dedicated memory, which it does not. Any memory not used by the GPU is available for others to use. That is the point I am making. You are thinking too much of a traditional system where there is a separate system memory and dedicated GPU memory. No such thing exists, so what one uses, the other can’t. Therefore memory allocation and availability is definitely affected by dyanamic caching, so it has everything to do with available memory, not nothing as you claim.You almost got it. The registers are not there to maintain a list of memory pages. The registers store the thread data. As I told you before, the GPU does not actually allocate system memory, it uses the memory given to it by the driver/OS.
On traditional architectures you have different types of thread storage: per-thread registers, per-simdgroup/wave registers (often called uniforms or "constants"), per-threadgroup/block shared memory (for cooperative work by multiple threads in the group), stack, as well as various caches. Most of these are usually implemented as different physical memory blocks on the GPU core and have different performance characteristics. What Apple did is unify all these memory blocks into one single shared pool of fast on-GPU memory and virtualised (as you correctly note) the individual storage types. So if in the old architecture a GPU register was backed by a concrete cell in a register file, assigned by the driver/firmware/scheduler when the kernel was queued, on Apple G16 a GPU register is backed by the unified "Dynamic Cache" storage. That's the gist of it.
Memory pages however are a completely different topic (accessing the system RAM or what Apple calls "device memory") and have nothing to do with the Dynamic Cache. As I mentioned before, Dynamic Cache is about allocation of on-GPU storage, not the DRAM.
Incorrect. I have a dozen users on 13” MBA w/ 8g. They’re great. We even created a KB article about M1 & 8g memory pressure for the complainers.Let me guess. You’ve never owned an 8GB Apple Silicon Mac.
I didn’t say the GPU allocates memory. It requests the memory, which is then supplied to it. You’ve almost got it. You got that unified memory means the CPU and GPU share the same memory, but somehow take that concept and miss its application. When the GPU is able to finish with its tasks quicker, allowing the memory to be released, that extra memory is freed up for the CPU to use because they share the same space. You would be correct only if the GPU had its own dedicated memory, which it does not. Any memory not used by the GPU is available for others to use. That is the point I am making. You are thinking too much of a traditional system where there is a separate system memory and dedicated GPU memory. No such thing exists, so what one uses, the other can’t. Therefore memory allocation and availability is definitely affected by dyanamic caching, so it has everything to do with available memory, not nothing as you claim.
I mentioned the two moving boxes Apple showed at the event. One showed a nearly empty box and some waves indicating GPU memory usage. Note the top was empty because the CPU was not allowed access to it, as it is reserved by the GPU. In the second box, the wave moves up and down rapidly as the memory is allocated and deallocated in real time. But you note the space above it is filled with another color. That’s the CPU taking advantage of the free memory that otherwise would be unused but allocated to the GPU. That is dynamic caching in action allowing more memory to be available to others.
Here’s a direct transcript from the October event from Srouji:You almost got it. The registers are not there to maintain a list of memory pages. The registers store the thread data. As I told you before, the GPU does not actually allocate system memory, it uses the memory given to it by the driver/OS.
On traditional architectures you have different types of thread storage: per-thread registers, per-simdgroup/wave registers (often called uniforms or "constants"), per-threadgroup/block shared memory (for cooperative work by multiple threads in the group), stack, as well as various caches. Most of these are usually implemented as different physical memory blocks on the GPU core and have different performance characteristics. What Apple did is unify all these memory blocks into one single shared pool of fast on-GPU memory and virtualised (as you correctly note) the individual storage types. So if in the old architecture a GPU register was backed by a concrete cell in a register file, assigned by the driver/firmware/scheduler when the kernel was queued, on Apple G16 a GPU register is backed by the unified "Dynamic Cache" storage. That's the gist of it.
Memory pages however are a completely different topic (accessing the system RAM or what Apple calls "device memory") and have nothing to do with the Dynamic Cache. As I mentioned before, Dynamic Cache is about allocation of on-GPU storage, not the DRAM.
Here’s a direct transcript from the October event from Srouji:
———
It starts with a new microarchitecture that has a breakthrough feature we call Dynamic Caching, an industry first. In a traditional graphics architecture, software determines the amount of local GPU memory that’s allocated to upcoming tasks at compile time.
This results in reserving the same amount of memory for every task based on the needs of the single most demanding task, which means the GPU is under utilized especially with complex programs.
In our next-generation GPU, local memory gets dynamically allocated in hardware in real time. SO ONLY THE EXACT AMOUNT OF MEMORY THAT IS NEEDED IS USED FOR EACH TASK (emphasis mine).
———-
That last sentence is what I’m getting at. Because the system does not pre-allocate excess memory ahead of time, less memory is needed by the GPU, because only the exact amount needed is used at any given time, rather than the maximum amount needed being reserved until the task is done. That old method of pre-allocation takes away memory from the CPU that sits there mostly unused by the GPU but is inaccessible to anyone else. This is what I mean when I say it is definitely all about freeing up memory for others to use.
This is straight from Johny Srouji’s mouth.
What was missing from the presentation was how they maximize GPU utilization, which is what the caching of the virtual registers does by keeping the pipeline moving without bottlenecks. That talk you posted answered that one question that everyone had after watching the presentation.
I have a work colleague that has the 13" M1 pro with 8GB (not his choice, he got it from a friend) and the 8GB is his biggest gripe apparently Chome with with a few tabs open kills it. I have a 16GB 14" M1 Pro and and it runs flawlessly. This video basically outlines the difference well:Does anyone have one of the modern machines? How much RAM does the system take up and how much is generally left for user apps?
I’m not an intensive user and I’m wondering if I could get by with the 8GB standard
8mb ram and 3300mb/s reads in 2023.. that's PC specs from pcie 3.0 PCs circa 2014....First AAPL robs you then they get their PR dept to gaslight us with bogus "8GB on Macs is the same as 16GB on PCs". You can fool some of the people some of the time.