NVIDIA · Data center · Accelerator card
NVIDIA L4 24GB
Exact L4 reference specifications and AI deployment guidance, separated from FusionPointAI commercial inventory.
Current
Available to rent
Verified technical specifications
| Manufacturer | NVIDIA |
|---|---|
| Exact SKU | L4 |
| Product family | NVIDIA L4 |
| Architecture | Ada Lovelace |
| Generation | Ada Data Center |
| Entity type | Accelerator card |
| Lifecycle | Current |
| Launch date | The manufacturer has not published this information. |
| VRAM | 24 GB |
| Memory technology | GDDR6 |
| Memory bandwidth | 300 GB/s |
| Power | 72 W |
| Interface | PCIe Gen4 x16 |
| Form factor | Low profile · PCIe · Accelerator |
| Interconnect | PCIe |
| MIG / partitioning | Not supported |
| Supported numeric formats | FP32, TF32, BF16, FP16, FP8, INT8 |
| Software stack | cuda, vllm, sglang, tensorrt-llm |
Compute
| Precision | Dense | With sparsity |
|---|---|---|
| FP32 | 30.3 TFLOPS | — |
| TF32 Tensor | 60 TFLOPS | 120 TFLOPS |
| BF16 Tensor | 121 TFLOPS | 242 TFLOPS |
| FP16 Tensor | 121 TFLOPS | 242 TFLOPS |
| FP8 Tensor | 242.5 TFLOPS | 485 TFLOPS |
| INT8 Tensor | 242.5 TOPS | 485 TOPS |
AI workload suitability
LLM inference
Best suited to smaller checkpoints, compressed models or distributed configurations sized by the recommendation engine.
Fine-tuning and training
Designed for sustained accelerator workloads; training suitability depends on interconnect, precision and cluster topology.
Image, video and embeddings
FP16 acceleration supports common generative and vector workloads within the listed VRAM envelope.
Power and cooling
72 W published power requires chassis, airflow and power delivery for this exact form factor.
Multi-GPU use
PCIe is the recorded interconnect path; topology must still be validated at node level.
Software ecosystem
cuda, vllm, sglang, tensorrt-llm
FusionPointAI rental
Current public inventory is mapped to this exact registry SKU.
Monthly rental price: USD 250 / month
View availability and configureProduct timeline
Media gallery
Official manufacturer source
https://www.nvidia.com/en-us/data-center/l4/
Last verified: 2026-08-24