As enterprises race to adopt generative AI and bring new services to market, the demands on data center infrastructure have never been greater. Training large language models is one challenge, but delivering LLM-powered real-time services is another. In the latest round of MLPerf industry benchmarks, Inference v4.1, NVIDIA platforms delivered leading performance across all data center tests. The first-ever submission of the upcoming NVIDIA Blackwell platform revealed up to 4x more performance than the NVIDIA H100 Tensor Core GPU on MLPerf's biggest LLM workload, Llama 2 70B, thanks to its use of a second-generation Transformer Engine and FP4 Tensor Cores.
https://www.techpowerup.com/326041/n...ence-benchmark
NVIDIA Blackwell Sets New Standard for Generative AI in MLPerf Inference Benchmark
29th August 2024, 09:05
NVIDIA Blackwell Sets New Standard for Generative AI in MLPerf Inference Benchmark 
