NVIDIA L4, Low Profile, PCIe 4.0 x16 GPU card; for AI, DL purposes, no graphic output. VDI function is also support.

NVIDIA L4

Breakthrough Universal Accelerator for Efficient Video, AI, and Graphics

With NVIDIA's AI platform and full-stack approach, L4 is optimized for video and inference at scale for a broad range of AI applications, including recommendations, voice-based AI avatar assistants, generative AI, visual search, and contact center automation to deliver the best personalized experiences. As the most efficient NVIDIA accelerator for mainstream, servers equipped with L4 enable up to 120X higher AI Video performance over CPU solutions, while providing 2.7X more generative AI performance, and over 4X more graphics performance versus the previous generation. NVIDIA L4's versatility and energy-efficient, single-slot, low-profile form factor make it ideal for global deployments, including edge locations.

As AI and video become more pervasive, the demand for efficient, cost effective computing is increasing more than ever. NVIDIA L4 GPUs deliver up to 99% better energy efficiency and lower total cost of ownership compared to traditional CPU-based infrastructure. This enables enterprises to reduce rack space and significantly lower the overall carbon footprint while making their data centers capable of scaling to many more users. The energy saved by switching from CPUs to NVIDIA L4s in a 2 megawatt (MW) data center can power over 2,000 homes for one year or the carbon offset from 172,000 trees grown over 10 years*.

Highlights

FP32

TF32 Tensor Core

FP16 Tensor Core

BFLOAT16 Tensor Core

FP8Tensor Core

INT8 Tensor Core

GPU Memory

GPU Memory Bandwidth

Display Connectors

NVENC | NVDEC

Form Factor

System Interconnect

Thermal Solution

Maximum Power Consumption

Server Options