Architecture |
Ada Lovelace |
GPU memory |
48GB GDDR6 with ECC |
Memory Bandwidth |
864GB/s |
Interconnect |
PCIe Gen4 x16 64GB/s |
|
Bi-directional |
NVIDIA Ada Lovelace architecture-based CUDA Cores |
18,176 |
NVIDIA 3rd Gen RT Cores |
142 |
NVIDIA 4th Gen Tensor Cores |
568 |
RT Core Performance TFLOPS |
209 |
FP32 TFLOPS |
91.6 |
TF32 Tensor Core TFLOPS |
183 || 366 with sparsity |
BFLOAT16 Tensor Core TFLOPS |
362.05 || 733 with sparsity |
FP16 Tensor Core TFLOPS |
362.05 || 733 with sparsity |
FP8 Tensor Core TFLOPS |
733 || 1,466 with sparsity |
Peak INT8 Tensor TOPS |
733 || 1,466 with sparsity |
Peak INT4 Tensor TOPS |
733 || 1,466 with sparsity |
Form Factor |
Dual-slot |
|
4.4" (H) x 10.5" (L) |
Display Ports |
4 * DisplayPort 1.4a |
Maximum Power Consumption |
350W |
Power Connector |
16-pin |
Thermal |
Passive |
Virtual GPU (vGPU) Software Support |
Yes |
vGPU Profiles Supported |
For supported profiles visit: https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/Virtual-GPU-Packaging-and-Licensing-Guide.pdf |
Encode/Decode |
3 * NVENC |
|
3 * NVDEC |
|
Includes AV1 Encode and Decode |
Secure Boot with Root of Trust |
Yes |
NEBS Ready |
Level 3 |
MIG Support |
No |
NVLink Support |
No |