Stefan Mileschin

Samsung, which recently announced its 12-high HBM3E memory, is expected to demonstrate them at the upcoming NVIDIA GTC 2024 event. Business Korea reports that the HBM3E stacks will power NVIDIA's "Hopper" H200 AI GPU, a more advanced version of the H100, which features support for HBM3E, and larger amounts of memory. Samsung's 12-high HBM3E stack has 12 layers of DRAM stacked with a Samsung innovation in wiring the stack. Each stack offers density as high as 288 Gbit, or 36 GB, which works out to 216 GB of memory over the 6144-bit HBM3E memory interface of the H200. Neither Samsung nor NVIDIA have put out DRAM speeds for the Samsung 12H HBM3E as configured for the H200.

https://www.techpowerup.com/320024/s...th-hopper-h200