Architecture | Ada Lovelace |
GPU memory | 24GB |
Memory Bandwidth | 300GB/s |
Interconnect | PCIe Gen4 x16 64GB/s |
FP32 | 30.3 TFLOPS |
TF32 Tensor Core | 120 TFLOPS with sparsity |
BFLOAT16 Tensor Core | 242 TFLOPS with sparsity |
FP16 Tensor Core | 242 TFLOPS with sparsity |
FP8 Tensor Core | 485 TFLOPS with sparsity |
INT8 Tensor Core | 485 TOPS with sparsity |
Max Thermal Design Power (TDP) | 72W |
Decoders | 2 * NVENC |
4 * NVDEC | |
4 * JPEG | |
Form Factor | PCIe |
Single-slot | |
Low-profile (HH, HL) | |
Server Options | Partner and NVIDIA-Certified Systems with 1-8 GPUs |