We are not talking about regular RAM here. This unified memory on apples chips is more comparable to vRAM on GPU’s. This demand for high memory is mainly due to running local AI. Regular RAM is just isn’t fast enough. Flagship GPUs have even higher bandwidth but they don’t ship with that much of vRAM. Apple with its M chips is uniquely positioned in the middle - it’s fast enough and you can have loads of it. M ultra chips is a hot buy for local inference.
All leading AI labs are offering their models at a loss, so inevitably they will jack up the prices once everyone is hooked. Meanwhile local models are getting only better. So there could be a point of inflection where companies just run some jacked up local hardware instead of paying ever increasing subscriptions. This is not investment advice, but it’s the reason I have been loading up as much Apple stock lately. If they release M5 ultra with one 1TB RAM and manage to keep up with the demand, even if it’ll cost over 20K it will be flying of the shelves (as it will still be much cheaper than comparable stuff from Nvidia).
All leading AI labs are offering their models at a loss, so inevitably they will jack up the prices once everyone is hooked. Meanwhile local models are getting only better. So there could be a point of inflection where companies just run some jacked up local hardware instead of paying ever increasing subscriptions. This is not investment advice, but it’s the reason I have been loading up as much Apple stock lately. If they release M5 ultra with one 1TB RAM and manage to keep up with the demand, even if it’ll cost over 20K it will be flying of the shelves (as it will still be much cheaper than comparable stuff from Nvidia).