Fastest
lfm2.5:8b-64k
8.5B
Highest token generation speed at 189.9 tok/s.
Hardware Benchmarks
Compare RTX 2070 Super benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for RTX 2070 Super.
Fastest
8.5B
Highest token generation speed at 189.9 tok/s.
Best quality
27B
Highest completed quality score at 85.0.
Largest context
7.46B
Largest context that fits in 8GB VRAM, at 131,072 tokens.
Every model the community ran on this hardware. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.
Medians over 11 fully rated runs of 7 models. Each quantization is its own model.
Which models actually run best on the RTX 2070 Super, by task, from community benchmark data.
Completed quality-ranked benchmark results for NVIDIA GeForce RTX 2070 SUPER.