AMD Instinct MI300X Accelerators Available on Oracle Cloud Infrastructure

Stefan Mileschin · 27th September 2024, 11:32

AMD today announced that Oracle Cloud Infrastructure (OCI) has chosen AMD Instinct MI300X accelerators with ROCm open software to power its newest OCI Compute Supercluster instance called BM.GPU.MI300X.8. For AI models that can comprise hundreds of billions of parameters, the OCI Supercluster with AMD MI300X supports up to 16,384 GPUs in a single cluster by harnessing the same ultrafast network fabric technology used by other accelerators on OCI. Designed to run demanding AI workloads including large language model (LLM) inference and training that requires high throughput with leading memory capacity and bandwidth, these OCI bare metal instances have already been adopted by companies including Fireworks AI.

https://www.techpowerup.com/327025/a...infrastructure

27th September 2024, 11:32	#1
Stefan Mileschin [M] Reviewer Join Date: May 2010 Location: Romania Posts: 152,670	AMD Instinct MI300X Accelerators Available on Oracle Cloud Infrastructure AMD today announced that Oracle Cloud Infrastructure (OCI) has chosen AMD Instinct MI300X accelerators with ROCm open software to power its newest OCI Compute Supercluster instance called BM.GPU.MI300X.8. For AI models that can comprise hundreds of billions of parameters, the OCI Supercluster with AMD MI300X supports up to 16,384 GPUs in a single cluster by harnessing the same ultrafast network fabric technology used by other accelerators on OCI. Designed to run demanding AI workloads including large language model (LLM) inference and training that requires high throughput with leading memory capacity and bandwidth, these OCI bare metal instances have already been adopted by companies including Fireworks AI. https://www.techpowerup.com/327025/a...infrastructure

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
AMD’s Instinct MI300X is competitive with Nvidia's H100 on AI	Stefan Mileschin	WebNews	0	5th September 2024 06:33
AMD's Radeon Instinct MI300X dominates Geekbench's OpenCL Benchmark	Stefan Mileschin	WebNews	0	27th June 2024 10:46
Lenovo Anticipates Great Demand for AMD Instinct MI300X Accelerator Products	Stefan Mileschin	WebNews	0	29th March 2024 11:33
AMD CTO Teases Memory Upgrades for Revised Instinct MI300-series Accelerators	Stefan Mileschin	WebNews	0	27th February 2024 08:28
AMD Instinct MI300X GPUs Featured in LaminiAI LLM Pods	Stefan Mileschin	WebNews	0	24th January 2024 07:39
AMD unveils Instinct MI300X and MI300A APU accelerators	Stefan Mileschin	WebNews	0	11th December 2023 11:42
AMD Expands AI/HPC Product Lineup With Flagship GPU-only Instinct Mi300X	Stefan Mileschin	WebNews	0	14th June 2023 07:16
AMD announces Radeon Instinct accelerators	Stefan Mileschin	WebNews	0	22nd June 2017 06:00
Sandisk aims disk at cloud infrastructure	Stefan Mileschin	WebNews	0	13th August 2015 06:34
Cloud infrastructure as a service in turmoil	Stefan Mileschin	WebNews	0	21st May 2015 05:33