Fastest
nemotron-3.5-lightning:latest
32.9B
311.5 tok/s
Highest token generation speed at 311.5 tok/s.
Hardware Benchmarks
Best Local LLM Performance for L4 + RTX Pro 6000 Blackwell Server Edition
Compare L4 + RTX Pro 6000 Blackwell Server Edition benchmark results and see which models actually earn the best completed quality scores.
Hardware Overview
GPU-specific specifications for local LLM planning.
- VRAM
- 118GB
- Architecture
- Multi-GPU
Recommended Models
Models we recommend for L4 + RTX Pro 6000 Blackwell Server Edition.
Best quality & Largest context
qwen3.8:27b
27.3B
109.3 tok/sQuality 86.7Context 65,536 tokens
Highest completed quality score at 86.7. Largest context that fits in 118GB VRAM, at 65,536 tokens.
Benchmark Results
Completed quality-ranked benchmark results for NVIDIA L4 + NVIDIA RTX PRO 6000 Blackwell Server Edition.