Panmnesia Uses CXL Protocol to Expand GPU Memory with Add-in DRAM Card or Even SSD

Stefan Mileschin · 3rd July 2024, 13:51

South Korean startup Panmnesia has unveiled an interesting solution to address the memory limitations of modern GPUs. The company has developed a low-latency Compute Express Link (CXL) IP that could help expand GPU memory with external add-in card. Current GPU-accelerated applications in AI and HPC are constrained by the set amount of memory built into GPUs. With data sizes growing by 3x yearly, GPU networks must keep getting larger just to fit the application in the local memory, benefiting latency and token generation. Panmnesia's proposed approach to fix this leverages the CXL protocol to expand GPU memory capacity using PCIe-connected DRAM or even SSDs. The company has overcome significant technical hurdles, including the absence of CXL logic fabric in GPUs and the limitations of existing unified virtual memory (UVM) systems.

https://www.techpowerup.com/324083/p...rd-or-even-ssd

3rd July 2024, 13:51	#1
Stefan Mileschin [M] Reviewer Join Date: May 2010 Location: Romania Posts: 152,449	Panmnesia Uses CXL Protocol to Expand GPU Memory with Add-in DRAM Card or Even SSD South Korean startup Panmnesia has unveiled an interesting solution to address the memory limitations of modern GPUs. The company has developed a low-latency Compute Express Link (CXL) IP that could help expand GPU memory with external add-in card. Current GPU-accelerated applications in AI and HPC are constrained by the set amount of memory built into GPUs. With data sizes growing by 3x yearly, GPU networks must keep getting larger just to fit the application in the local memory, benefiting latency and token generation. Panmnesia's proposed approach to fix this leverages the CXL protocol to expand GPU memory capacity using PCIe-connected DRAM or even SSDs. The company has overcome significant technical hurdles, including the absence of CXL logic fabric in GPUs and the limitations of existing unified virtual memory (UVM) systems. https://www.techpowerup.com/324083/p...rd-or-even-ssd

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Versatile DRAM Board Adds Memory to Any Heathkit H8 Variant	Stefan Mileschin	WebNews	0	28th April 2023 10:44
ChangXin Memory Technologies (CXMT) is Ramping up Chinese DRAM	Stefan Mileschin	WebNews	0	3rd December 2019 07:33
Microchip Announces DRAM Controller For OpenCAPI Memory Interface	Stefan Mileschin	WebNews	0	6th August 2019 09:46
Bain promises to expand Toshiba Memory	Stefan Mileschin	WebNews	0	4th June 2018 12:47
Chinese DRAM Industry Spreading Its Wings: Two More DRAM Fabs Ready	Stefan Mileschin	WebNews	0	27th April 2018 13:27
Marvell Implements Host Memory Buffer for DRAM-less 88NV1140 SSD Controller	Stefan Mileschin	WebNews	0	14th January 2016 07:54
DRAM Production Cuts Take Effect, Likely to Lead to a Rebound for DRAM Prices	Stefan Mileschin	WebNews	0	30th October 2012 07:21
Patriot Memory Releases New Viper 3 High Performance DRAM	Stefan Mileschin	WebNews	0	5th June 2012 07:56
Microsoft joins Hybrid Memory Cube Consortium to develop new DRAM standard	Stefan Mileschin	WebNews	0	10th May 2012 07:11
Magnetic memory ready to knock DRAM off pedestal	jmke	WebNews	0	11th June 2008 13:52