NVIDIA L40

L40 GPU

• Third-Generation RT Cores
  • Enhanced throughput and concurrent ray-tracing and shading capabilities improve ray-tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware-accelerated motion blur to deliver stunning real-time animations.
• Fourth-Generation Tensor Cores
  • Hardware support for structural sparsity and optimized TF32 format provides out-of-the-box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities, including DLSS, delivering upscaled resolution with better performance in select applications.
• Large GPU Memory
  • Tackle memory-intensive applications and workloads like data science, simulation, 3D modeling, and rendering with 48GB of ultra-fast GDDR6 memory. Allocate memory to multiple users with vGPU software to distribute large workloads among creative, data science, and design teams.
• Data-Center Ready
  • Designed for 24x7 enterprise data center operations with power-efficient hardware and components, the NVIDIA L40 is optimized to deploy at scale and deliver maximum performance for a diverse range of data center workloads. The L40 includes secure boot with root of trust technology providing an additional layer of security, and is NEBS Level 3 compliant to meet the latest data center standards. Packaged in a dual-slot, passively cooled and power-efficient design, the L40 is available in a wide variety of NVIDIA-Certified Systems™ from leading OEM vendors.

• GPU Architecture NVIDIA Ada Lovelace architecture
• GPU Memory 48GB GDDR6 with ECC
• Memory Bandwidth 864GB/s
• Interconnect Interface PCIe Gen4x16: 64GB/s bi-directional
• NVIDIA Ada Lovelace architecture-based CUDA Cores 18,176
• NVIDIA third-generation RT Cores 142
• NVIDIA fourth-generation Tensor Cores 568
• RT Core performance TFLOPS 209
• FP32 TFLOPS 90.5
• TF32 Tensor Core TFLOPS 90.5 | 181
• BFLOAT16 Tensor Core TFLOPS 181.05 | 362.1
• FP16 Tensor Core 181.05 | 362.1
• FP8 Tensor Core 362 | 724
• Peak INT8 Tensor TOPS 362 | 724
• Peak INT4 Tensor TOPS 724 | 1448
• Form Factor 4.4” (H) x 10.5” (L) - dual slot
• Display Ports 4 x DisplayPort 1.4a
• Max Power Consumption 300W
• Power Connector 16-pin
• Thermal Passive
• Virtual GPU (vGPU) software support Yes
• NVENC I NVDEC 3x l 3x (Includes AV1 Encode & Decode)
• Secure Boot with Root of Trust Yes
• NEBS Ready Level 3
• MIG Support No
• NVLink Support No