Fastest & Largest context
GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF
1B
Highest token generation speed at 148.8 tok/s. Largest context that fits in 8GB VRAM, at 8,192 tokens.
Hardware Benchmarks
Compare RTX 2070 benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for RTX 2070.
Fastest & Largest context
1B
Highest token generation speed at 148.8 tok/s. Largest context that fits in 8GB VRAM, at 8,192 tokens.
Best quality
9B
Highest completed quality score at 74.1.
Every model the community ran on this hardware. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.
Medians over 5 fully rated runs of 5 models. Each quantization is its own model.
Which models actually run best on the RTX 2070, by task, from community benchmark data.
Completed quality-ranked benchmark results for NVIDIA GeForce RTX 2070.