| Thread Tools |
31st July 2024, 07:38 | #1 |
[M] Reviewer Join Date: May 2010 Location: Romania
Posts: 152,436
| Apple Trained its Apple Intelligence Models on Google TPUs, Not NVIDIA GPUs Apple has disclosed that its newly announced Apple Intelligence features were developed using Google's Tensor Processing Units (TPUs) rather than NVIDIA's widely adopted hardware accelerators like H100. This unexpected choice was detailed in an official Apple research paper, shedding light on the company's approach to AI development. The paper outlines how systems equipped with Google's TPUv4 and TPUv5 chips played a crucial role in creating Apple Foundation Models (AFMs). These models, including AFM-server and AFM-on-device, are designed to power both online and offline Apple Intelligence features introduced at WWDC 2024. For the training of the 6.4 billion parameter AFM-server, Apple's largest language model, the company utilized an impressive array of 8,192 TPUv4 chips, provisioned as 8×1024 chip slices. The training process involved a three-stage approach, processing a total of 7.4 trillion tokens. Meanwhile, the more compact 3 billion parameter AFM-on-device model, optimized for on-device processing, was trained using 2,048 TPUv5p chips. https://www.techpowerup.com/325066/a...ot-nvidia-gpus |
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Apple Intelligence is delayed | Stefan Mileschin | WebNews | 0 | 30th July 2024 06:52 |
Apple confirms you need an upgrade for its “Apple Intelligence" | Stefan Mileschin | WebNews | 0 | 21st June 2024 08:34 |
Apple refuses to call Apple Intelligence 'AI' | Stefan Mileschin | WebNews | 0 | 12th June 2024 07:41 |
How Apple Intelligence could avoid Microsoft and Google's AI mistakes | Stefan Mileschin | WebNews | 0 | 11th June 2024 07:37 |
Apple's first attempt at AI is Apple Intelligence | Stefan Mileschin | WebNews | 0 | 11th June 2024 07:29 |
Apple's AI push will reportedly be called Apple Intelligence, of course | Stefan Mileschin | WebNews | 0 | 10th June 2024 07:06 |
Apple hopes to get more intelligence from Google | Stefan Mileschin | WebNews | 0 | 5th April 2018 07:47 |
Apple buys more intelligence | Stefan Mileschin | WebNews | 0 | 10th January 2016 11:04 |
Apple poaches NVIDIA's artificial intelligence leader | Stefan Mileschin | WebNews | 0 | 26th October 2015 07:26 |
Ten Dell models have defective Nvidia GPUs | jmke | WebNews | 0 | 28th July 2008 12:40 |
Thread Tools | |
| |