NVIDIA GB200 NVL72

NVIDIA GB200 NVL72

Power next-gen compute and AI with the NVIDIA GB200 NVL72

NVIDIA GB200 NVL72

The NVIDIA GB200 NVL72 is a breakthrough AI computing platform designed for massive-scale generative AI and LLM workloads. Featuring 72 NVIDIA Blackwell GPUs, high-speed NVLink interconnects, and advanced energy efficiency, it delivers unmatched performance for training and inference, making it the ultimate solution for AI data centers.

Key Features

  • Unleash AI at scale - The GB200 NVL72 connects 72 Blackwell GPUs with high-speed NVLink, delivering unmatched performance for massive AI and LLM workloads.
  • Maximum efficiency, minimum energy - With advanced cooling and power optimisation, the GB200 boosts AI performance while reducing energy consumption and total cost of ownership.
  • Seamless multi-GPU acceleration - NVIDIA NVLink Switch System enables ultra-fast communication between GPUs, ensuring smooth, scalable training and inference for the most demanding AI models.

Specifications

Configuration 36 Grace CPUs : 72 Blackwell GPUs
FP4 Tensor Core2 1,440 PFLOPS
FP8/FP6 Tensor Core2 720 PFLOPS
INT8 Tensor Core2 720 POPS
FP16/BF16 Tensor Core2 360 PFLOPS
TF32 Tensor Core 180 PFLOPS
FP32 6,480 TFLOPS
FP64 3,240 TFLOPS
FP64 Tensor Core 3,240 TFLOPS
GPU Memory | Bandwidth Up to 13.5 TB HBM3e | 576 TB/s
NVLink Bandwidth 130TB/s
CPU Core Count 2,592 Arm® Neoverse V2 cores
CPU Memory | Bandwidth Up to 17 TB LPDDR5X | Up to 18.4 TB/s
For full product specifications and parts list - download the NVIDIA GB200 NVL72 data sheet.