Thanks for the reply. The following questions are not just for you but anyone who cares to comment:
Ok, assuming that is true, that it's a memory limitation that prevents the AI from running locally, then why do other AI models run fine locally on the same device? The A16 with 6GB of RAM is hardly a compute slouch.
And why did Apple bother shipping a 16-core neural processor in the 14 Pro Max, a hardware AI capability that was advertised heavily by them and part of the reason why I bought it?
Also, if there really isn't enough memory on the local device, then why wouldn't Apple just use their private cloud computing for AI to do it, the same one that Craig Federighi was talking about in the Glowtime event?