What is the best local model for coding on the RTX 2060?

On the RTX 2060, inclusionAI/Ling-3.0-tiny-GGUF:Q4_K_M ranks first for coding in our benchmarks (0.0/100 at ~33.0 tok/s).

What is the best local model for agentic workflows on the RTX 2060?

On the RTX 2060, inclusionAI/Ling-3.0-tiny-GGUF:Q4_K_M ranks first for agentic workflows in our benchmarks (75.6/100 at ~33.0 tok/s).

Hardware Benchmarks

Name: NVIDIA GeForce RTX 2060
Brand: NVIDIA

Compare RTX 2060 benchmark results and see which models actually earn the best completed quality scores.

GPU-specific specifications for local LLM planning.

NVIDIA GeForce RTX 2060

Models we recommend for RTX 2060.

Fastest

Unknown

33.0 tok/s

Highest token generation speed at 33.0 tok/s.

Best quality & Largest context

35B

13.2 tok/sQuality 59.4Context 8.192 tokens

Highest completed quality score at 59.4. Largest context that fits in 5GB VRAM, at 8.192 tokens.

Which models actually run best on the RTX 2060, by task, from community benchmark data.

What is the best local model for coding on the RTX 2060?: On the RTX 2060, inclusionAI/Ling-3.0-tiny-GGUF:Q4_K_M ranks first for coding in our benchmarks (0.0/100 at ~33.0 tok/s).
What is the best local model for agentic workflows on the RTX 2060?: On the RTX 2060, inclusionAI/Ling-3.0-tiny-GGUF:Q4_K_M ranks first for agentic workflows in our benchmarks (75.6/100 at ~33.0 tok/s).

Completed quality-ranked benchmark results for NVIDIA GeForce RTX 2060.