NVIDIA L40S

NVIDIA L40S

NVIDIA L40S GPU: Optimised performance for AI and graphics workloads

NVIDIA L40S

Unlock your data center's potential with the NVIDIA L40S GPU. This versatile and efficient solution accelerates AI and graphics workloads, delivering up to 120X faster AI video processing compared to CPUs. The L40S empowers real-time insights, content delivery, and smooth operation for diverse applications. It also minimises energy consumption and costs.

Key Features

  • Energy-efficient performance - Reduce operational costs and environmental impact with the L40S's focus on energy efficiency, allowing you to achieve optimal performance without sacrificing sustainability.
  • Cost-effective and versatilel - The L40S balances power and affordability, making it ideal for diverse server deployments and applications like video streaming, content creation, and virtual reality (VR).
  • Enhanced security - Built to meet data center security standards, NVIDIA's L40S features secure boot with root of trust technology for added protection of your sensitive data.

Specifications

Architecture Ada Lovelace
GPU memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect PCIe Gen4 x16 64GB/s
Bi-directional
NVIDIA Ada Lovelace architecture-based CUDA Cores 18,176
NVIDIA 3rd Gen RT Cores 142
NVIDIA 4th Gen Tensor Cores 568
RT Core Performance TFLOPS 209
FP32 TFLOPS 91.6
TF32 Tensor Core TFLOPS 183 || 366 with sparsity
BFLOAT16 Tensor Core TFLOPS 362.05 || 733 with sparsity
FP16 Tensor Core TFLOPS 362.05 || 733 with sparsity
FP8 Tensor Core TFLOPS 733 || 1,466 with sparsity
Peak INT8 Tensor TOPS 733 || 1,466 with sparsity
Peak INT4 Tensor TOPS 733 || 1,466 with sparsity
Form Factor Dual-slot
4.4" (H) x 10.5" (L)
Display Ports 4 * DisplayPort 1.4a
Maximum Power Consumption 350W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles Supported For supported profiles visit: https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/Virtual-GPU-Packaging-and-Licensing-Guide.pdf
Encode/Decode 3 * NVENC
3 * NVDEC
Includes AV1 Encode and Decode
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVLink Support No