Fastest
LiquidAI/LFM2.5-350M-GGUF:F16
Unknown
Highest token generation speed at 665.0 tok/s.
Hardware Benchmarks
Compare RTX 3080 + RTX 3080 Ti benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for RTX 3080 + RTX 3080 Ti.
Fastest
Unknown
Highest token generation speed at 665.0 tok/s.
Best quality
27B
Highest completed quality score at 89.6.
Largest context
27B
Largest context that fits in 32GB VRAM, at 262,144 tokens.
Every model the community ran on this hardware. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.
Medians over 35 fully rated runs of 24 models. Each quantization is its own model.
Which models actually run best on the RTX 3080 + RTX 3080 Ti, by task, from community benchmark data.
Completed quality-ranked benchmark results for NVIDIA GeForce RTX 3080 + NVIDIA GeForce RTX 3080 Ti.