Architecture | Hopper™ |
GPU memory | 80GB HBM2 |
Memory Bandwidth | 2TB/s |
Interconnect | NVIDIA® NVLINK® 600GB/s PCIe |
Gen5: 128GB/s | |
FP64 | 26 TFLOPS |
FP64 Tensor Core | 51 TFLOPS |
FP32 | 51 TFLOPS |
TF32 Tensor Core | 756 TFLOPS with sparsity |
BFLOAT16 Tensor Core | 1,979 TFLOPS with sparsity |
FP16 Tensor Core | 1,513 TFLOPS with sparsity |
FP8 Tensor Core | 3,026 TFLOPS with sparsity |
INT8 Tensor Core | 3,026 TOPS with sparsity |
Max Thermal Design Power (TDP) | 300 - 350W (configurable) |
Decoders | 7 * NVDEC |
7 * JPEG | |
Multi-instance GPUs (MIGs) | Up to 7 MIGs @ 10GB each |
Form Factor | PCIe |
Dual-slot | |
Air-cooled | |
Server Options | Partner and NVIDIA-Certified Systems with 1-8 GPUs |
NVIDIA Enterprise | Included |