NVIDIA GB200 NVL72

NVIDIA GB200 NVL72

Power next-gen compute and AI with the NVIDIA GB200 NVL72

NVIDIA GB200 NVL72

The NVIDIA GB200 NVL72 is a breakthrough AI computing platform designed for massive-scale generative AI and LLM workloads. Featuring 72 NVIDIA Blackwell GPUs, high-speed NVLink interconnects, and advanced energy efficiency, it delivers unmatched performance for training and inference, making it the ultimate solution for AI data centers.
Panchaea Product Images NVIDIA GB200 NVL72 2000x1296 4

Key Features

  • Unleash AI at scale - The GB200 NVL72 connects 72 Blackwell GPUs with high-speed NVLink, delivering unmatched performance for massive AI and LLM workloads.
  • Maximum efficiency, minimum energy - With advanced cooling and power optimisation, the GB200 boosts AI performance while reducing energy consumption and total cost of ownership.
  • Seamless multi-GPU acceleration - NVIDIA NVLink Switch System enables ultra-fast communication between GPUs, ensuring smooth, scalable training and inference for the most demanding AI models.

Specifications

Configuration 36 Grace CPUs : 72 Blackwell GPUs
FP4 Tensor Core2 1,440 PFLOPS
FP8/FP6 Tensor Core2 720 PFLOPS
INT8 Tensor Core2 720 POPS
FP16/BF16 Tensor Core2 360 PFLOPS
TF32 Tensor Core 180 PFLOPS
FP32 6,480 TFLOPS
FP64 3,240 TFLOPS
FP64 Tensor Core 3,240 TFLOPS
GPU Memory | Bandwidth Up to 13.5 TB HBM3e | 576 TB/s
NVLink Bandwidth 130TB/s
CPU Core Count 2,592 Arm® Neoverse V2 cores
CPU Memory | Bandwidth Up to 17 TB LPDDR5X | Up to 18.4 TB/s
For full product specifications and parts list - download the NVIDIA GB200 NVL72 data sheet.