What is the best local model for coding on the RTX 4090?

On the RTX 4090, meta/muse-glimmer ranks first for coding in our benchmarks (83.9/100 at ~28.3 tok/s). unsloth/Qwen3.8-27B-GGUF:IQ3_S is faster (~104.3 tok/s) and still scores well (83.0/100) — a good pick if you'd rather trade a little quality for speed.

What is the best local model for agentic workflows on the RTX 4090?

On the RTX 4090, unsloth/Qwen3.8-27B-GGUF:IQ3_S ranks first for agentic workflows in our benchmarks (86.2/100 at ~104.3 tok/s).

Hardware Benchmarks

Best Local LLM Performance for RTX 4090

Compare RTX 4090 benchmark results and see which models actually earn the best completed quality scores.

ShareReddit X

Hardware Overview

GPU-specific specifications for local LLM planning.

NVIDIA GeForce RTX 4090

VRAM: 24GB

Recommended Models

Models we recommend for RTX 4090.

Fastest

google/gemma-4-26b-a4b-qat

26B

157.0 tok/s

Highest token generation speed at 157.0 tok/s.

Best quality

unsloth/Qwen3.8-27B-GGUF:IQ3_S

27B

105.6 tok/sQuality 88.4

Highest completed quality score at 88.4.

Frequently asked questions

Which models actually run best on the RTX 4090, by task, from community benchmark data.

What is the best local model for coding on the RTX 4090?: On the RTX 4090, meta/muse-glimmer ranks first for coding in our benchmarks (83.9/100 at ~28.3 tok/s). unsloth/Qwen3.8-27B-GGUF:IQ3_S is faster (~104.3 tok/s) and still scores well (83.0/100) — a good pick if you'd rather trade a little quality for speed.
What is the best local model for agentic workflows on the RTX 4090?: On the RTX 4090, unsloth/Qwen3.8-27B-GGUF:IQ3_S ranks first for agentic workflows in our benchmarks (86.2/100 at ~104.3 tok/s).

Benchmark Results

Completed quality-ranked benchmark results for NVIDIA GeForce RTX 4090.

Open run page →