Fastest
mistralai/ministral-3-3b
3B
77.5 tok/s
Highest token generation speed at 77.5 tok/s.
Hardware Benchmarks
Compare 4× Gtx 1080 Ti benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for 4× Gtx 1080 Ti.
Fastest
3B
Highest token generation speed at 77.5 tok/s.
Best quality
27B
Highest completed quality score at 75.3.
Largest context
9B
Largest context that fits in 44GB VRAM, at 2,048,000 tokens.
Which models actually run best on the 4× Gtx 1080 Ti, by task, from community benchmark data.
Completed quality-ranked benchmark results for 4× NVIDIA GeForce GTX 1080 Ti.