Hardware Benchmarks

Best Local LLM Performance for RTX 2070

Compare RTX 2070 benchmark results and see which models actually earn the best completed quality scores.

ShareRedditX

Hardware Overview

GPU-specific specifications for local LLM planning.

NVIDIA GeForce RTX 2070
VRAM
8GB

Recommended Models

Models we recommend for RTX 2070.

Fastest & Largest context

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

1B

148.8 tok/sContext 8,192 tokens

Highest token generation speed at 148.8 tok/s. Largest context that fits in 8GB VRAM, at 8,192 tokens.

Best quality

unsloth/Qwen3.5-9B-GGUF

9B

52.2 tok/sQuality 74.1

Highest completed quality score at 74.1.

Models on the RTX 2070

Every model the community ran on this hardware. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read10305070902050100tok/s (log scale) →quality →

Medians over 5 fully rated runs of 5 models. Each quantization is its own model.

Frequently asked questions

Which models actually run best on the RTX 2070, by task, from community benchmark data.

What is the best local model for coding on the RTX 2070?
On the RTX 2070, unsloth/Qwen3.5-9B-GGUF ranks first for coding in our benchmarks (63.9/100 at ~52.2 tok/s).
What is the best local model for agentic workflows on the RTX 2070?
On the RTX 2070, empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF ranks first for agentic workflows in our benchmarks (81.6/100 at ~54.7 tok/s).

Benchmark Results

Completed quality-ranked benchmark results for NVIDIA GeForce RTX 2070.