Apple says it uses no Nvidia GPUs to train its AI models

SAN FRANCISCO — Apple relied on chips designed by Alphabet's Google rather than industry leader Nvidia to build its new artificial-intelligence software infrastructure that will power its forthcoming suite of AI tools and features, according to an Apple research paper it published on Monday (July 29).

Apple's decision to rely on Google's cloud infrastructure is notable because Nvidia produces the most sought-after AI processors. Including the chips made by Google, Amazon.com and other cloud computing companies, Nvidia commands roughly 80 per cent of the market.

In the research paper, Apple did not explicitly say that it uses no Nvidia chips, but its description of the hardware and software infrastructure of its AI tools and features lacked any mention of Nvidia hardware.

Apple could not immediately be reached for comment on Monday.

Apple said in the research paper that to train its AI models, it used two flavours of Google's tensor processing unit (TPU) that are organised in large clusters of chips. To build the AI model that will operate on iPhones and other devices, Apple used 2,048 of the TPUv5p chips. For its server AI model, Apple deployed 8,192 TPUv4 processors.

Nvidia does not design TPUs but rather focuses its efforts on so-called graphics processing units (GPUs) that are widely used for AI efforts.

Unlike Nvidia, which sells its chips and systems as standalone products, Google sells access to the TPUs through its Google Cloud Platform. Customers interested in buying access must build software through Google's cloud platform in order to use the chips.

Apple is rolling out portions Apple Intelligence to its beta users this week.

Reuters reported the use of the TPU chips in June but Apple did not disclose the full extent of its reliance on Google hardware until Monday's research paper.

Google did not return a request for comment, and Nvidia declined to comment.

Apple's engineers said in the paper it would be possible to make even larger, more sophisticated models with Google's chips, than the two models it discussed in the paper.

Apple unveiled a slew of new AI features at its June developer conference, including integrating OpenAI's ChatGPT technology into its software.

[[nid:694518]]