Apple is expected to spend several billion on hardware to support its artificial intelligence development in 2024, according to speculation from Apple analyst Ming-Chi Kuo. Kuo expects Apple to spend "at least" $620 million on servers in 2023 and $4.75 billion on servers in 2024.
Apple could purchase between 2,000 and 3,000 servers this year, and up to 20,000 next year. Kuo thinks that Apple is purchasing servers equipped with Nvidia's HGX H100 8-GPU for generative AI training, with the company planning to upgrade to B100 next year. Nvidia calls its H100 an AI supercomputing platform, and each one is priced at around $250,000.
Kuo appears to be guessing at Apple's purchasing plans here, and he says that he expects Apple will use AI servers it is purchasing and installing itself to train large language models rather than virtual hosting from other cloud service providers for improved security and privacy. He does say that Apple could develop its own server chips to save on server costs, but he has seen no evidence that Apple is doing that at this time.
While Apple appears to be making a major investment into AI, Apple's server purchasing will fall behind other companies like Meta and Microsoft. Apple will also need to invest in labor costs, infrastructure, and more, and Kuo suggests that Apple will need to spend several billion dollars annually to have a chance of catching up with competitors. Kuo claims that he is "genuinely concerned" about the future of Apple's generative AI business if Apple spends just a billion dollars a year as suggested by Bloomberg's Mark Gurman.
Over the weekend, Gurman said that Apple is on track to spend $1 billion per year on its AI efforts. Gurman says that Apple is working on a new, smarter version of Siri and is aiming to integrate AI into many Apple apps.
Article Link: Kuo: Apple Could Spend $4.75 Billion on AI Servers in 2024
