What is the best local model for coding on the RTX 4070?

On the RTX 4070, iq3xxs ranks first for coding in our benchmarks (85.4/100 at ~18.1 tok/s).

What is the best local model for agentic workflows on the RTX 4070?

On the RTX 4070, iq3xxs ranks first for agentic workflows in our benchmarks (86.6/100 at ~18.1 tok/s). pq2 is faster (~48.4 tok/s) and still scores well (85.4/100) — a good pick if you'd rather trade a little quality for speed.

Hardware Benchmarks

Best Local LLM Performance for RTX 4070

Name: NVIDIA GeForce RTX 4070
Brand: NVIDIA

Compare RTX 4070 benchmark results and see which models actually earn the best completed quality scores.

ShareReddit X

Hardware Overview

GPU-specific specifications for local LLM planning.

NVIDIA GeForce RTX 4070

VRAM: 11GB

Recommended Models

Models we recommend for RTX 4070.

Fastest

LFM2.5-8B-A1B-Q4_K_M

281.5 tok/s

Highest token generation speed at 281.5 tok/s.

Best quality & Largest context

iq3xxs

Unknown

18.1 tok/sQuality 87.4Context 8.192 tokens

Highest completed quality score at 87.4. Largest context that fits in 11GB VRAM, at 8.192 tokens.

Frequently asked questions

Which models actually run best on the RTX 4070, by task, from community benchmark data.

What is the best local model for coding on the RTX 4070?: On the RTX 4070, iq3xxs ranks first for coding in our benchmarks (85.4/100 at ~18.1 tok/s).
What is the best local model for agentic workflows on the RTX 4070?: On the RTX 4070, iq3xxs ranks first for agentic workflows in our benchmarks (86.6/100 at ~18.1 tok/s). pq2 is faster (~48.4 tok/s) and still scores well (85.4/100) — a good pick if you'd rather trade a little quality for speed.

Benchmark Results

Completed quality-ranked benchmark results for NVIDIA GeForce RTX 4070.