NVIDIA L40

NVIDIA L40

NVIDIA L40 GPU: Powering the future of data center performance

NVIDIA L40

NVIDIA's L4 Tensor Core GPU revolutionises data center AI and graphics performance. This next-generation accelerator delivers unparalleled performance for various demanding workloads, from deep learning and machine learning (ML) to graphics processing and remote workstations.
Panchaea Product Images NVIDIA L40 2000x1296 1

Key Features

  • Unmatched performance - The NVIDIA L40 delivers groundbreaking visualisation, supercharges AI tasks, and boosts compute power, tackling demanding data center workloads efficiently.
  • Built for reliability - Designed for 24/7 operation, with scalable deployment and security features, the L40 ensures maximum uptime and data protection.
  • Optimised for efficiency - The L40 minimises power consumption with its energy-efficient design and passive cooling, reducing costs and simplifying data center management.

Specifications

Architecture Ada Lovelace
GPU memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect PCIe Gen4 x16 64GB/s
Bi-directional
NVIDIA Ada Lovelace architecture-based CUDA Cores 18,176
NVIDIA 3rd Gen RT Cores 142
NVIDIA 4th Gen Tensor Cores 568
RT Core Performance TFLOPS 209 TFLOPS
FP32 TFLOPS 90.5 TFLOPS
TF32 Tensor Core TFLOPS 90.5 || 181 with sparsity
BFLOAT16 Tensor Core TFLOPS 181.05 || 362.1 with sparsity
FP16 Tensor Core TFLOPS 181.05 || 362.1 with sparsity
FP8 Tensor Core TFLOPS 362 || 724 with sparsity
Peak INT8 Tensor TOPS 362 || 724 with sparsity
Peak INT4 Tensor TOPS 724 || 1448 with sparsity
Form Factor Dual-slot
4.4" (H) x 10.5" (L)
Display Ports 4 * DisplayPort 1.4a
Maximum Power Consumption 300W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles Supported For supported profiles visit: https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/Virtual-GPU-Packaging-and-Licensing-Guide.pdf
Encode/Decode 3 * NVENC
3 * NVDEC
Includes AV1 Encode and Decode
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVLink Support No