NVIDIA L40S - GPU computing processor - NVIDIA L40S - 48 GB GDDR6 - PCIe 4.0 x16 - 4 x DisplayPort - fanless
- Brand
- NVIDIA GCC
- Product code
- 900-2G133-0080-000
- SKU
- BNU6L5ILSWPPF
- EAN/GTIN
- 8592978477530
- GPU computing processor
- NVIDIA L40S
- 48 GB GDDR6
- PCIe 4.0 x16
- 4 x DisplayPort
- fanless
- Weight: 1.32 KG
Generative AI is fueling transformative change, unlocking a frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads. The NVIDIA L40S GPU is a powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications - from generative AI and model training and inference to 3D graphics, rendering, and video applications.
Description
4th gen Tensor Cores
Hardware support for structural sparsity and optimized TF32 format provides out-of-the-box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities with DLSS to upscale resolution with better performance in select applications.
Third-generation RT cores
Enhanced throughput and concurrent ray-tracing and shading capabilities improve ray-tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware-accelerated motion blur and stunning real-time animations.
Transformer Engine
Transformer Engine dramatically accelerates AI performance and improves memory utilization for both training and inference. Harnessing the power of the Ada Lovelace 4th gen Tensor Cores, Transformer Engine intelligently scans the layers of transformer architecture neural networks and automatically recasts between FP8 and FP16 precisions to deliver faster AI performance and accelerate training and inference.
Data center ready
The L40S GPU is optimized for 24/7 enterprise data center operations and designed, built, tested, and supported by NVIDIA to ensure maximum performance, durability, and uptime. The L40S GPU meets advanced data center standards, is Network Equipment-Building System (NEBS) Level 3 ready, and features secure boot with root of trust technology, providing an additional layer of security for data centers.
| General | |
|---|---|
| Interfaces Details | DisplayPort |
| Device Type | GPU computing processor - fanless |
| Bus Type | PCI Express 4.0 x16 |
| CUDA Cores | 18176 |
| Graphics Engine | NVIDIA L40S |
| Features | NVIDIA Ada Lovelace GPU technology, Nvidia DLSS, Nvidia Virtual GPU, Error Correcting Codes (ECC) Memory, 142 NVIDIA RT Cores, 568 NVIDIA Tensor Cores, 212 Tflops RT Core performance, NVDEC support, NVENC support, NVIDIA Omniverse Enterprise, secure boot with root of trust, dual slot width, 4th gen Tensor Cores, Real-Time Ray Tracing |
| Memory | |
| Size | 48 GB |
| Technology | GDDR6 SDRAM |
| Bandwidth | 864 GBps |
| Miscellaneous | |
| Power Consumption Operational | 350 Watt |
| Height | 11.2 cm |
| Depth | 26.7 cm |
| Compliant Standards | NEBS level 3, DisplayPort 1.4a |
| System Requirements | |
| Additional Requirements | 16 pin PCI Express power connector |
| Performance | |
| AI Datatype Support on NPU | INT4, INT8 |
| NPU Performance Up To (TOPS) | 733 TOPS |