Model benchmarks

gpt-oss:20b local LLM performance

As of October 2026, gpt-oss:20b runs at up to 155.2 tok/s for local inference (best of 35 community benchmark runs across 11 GPUs).

LM StudioOllamaMXFP4MXFP4_MOE
ShareRedditX

Model size

20.9B

Peak speed

155.2 tok/s

Average speed

77.7 tok/s

Avg PP

2083.9 tok/s

Min memory

382 MB

Max context

256,000 tokens

Avg output / run

9,771 tokens

Avg runtime / run

6m 17s

Avg quality

70.3

Benchmark runs

35

GPUs tested

11

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 35 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall58.870.378.1
Agent Workflow51.277.790.0
Code Generation40.863.377.3
Role Play & Narrative54.267.276.6
Research & Analysis59.073.282.3

Performance by hardware and tool

Every hardware/tool/quantization combination gpt-oss:20b has been benchmarked on, ranked by peak token generation speed. Last updated October 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
NVIDIA GeForce RTX 4070 Ti SUPERLM Studio—155.2 tok/s151.7 tok/sn/a16,384 tokens70.82
AMD Radeon RX 9070/9070 XT/9070 GREOllamaMXFP4_MOE132.4 tok/s132.4 tok/s10.9 GB98,304 tokens78.81
NVIDIA L40SOllamaMXFP4120.7 tok/s120.7 tok/s12.0 GB8,192 tokens76.51
AMD Radeon RX 7900 XTXLM Studio—111.1 tok/s109.1 tok/sn/a256,000 tokens67.09
AMD Radeon RX 7800 XTOllamaMXFP493.5 tok/s89.7 tok/s11.9 GB65,536 tokens73.53
AMD Radeon RX 7900 XTXOllamaMXFP470.6 tok/s62.0 tok/s13.1 GB65,536 tokens73.511
NVIDIA GeForce RTX 5080OllamaMXFP464.0 tok/s35.0 tok/s13.3 GB65,536 tokens62.42
Apple M5LM Studio—45.3 tok/s45.3 tok/sn/a8,192 tokens74.01
NVIDIA GeForce RTX 5070LM Studio—34.8 tok/s34.8 tok/sn/a65,536 tokens72.81
Apple M1 ProOllamaMXFP431.1 tok/s31.1 tok/s11.9 GB8,192 tokens40.71
Apple M4OllamaMXFP425.3 tok/s25.3 tok/s382 MB8,192 tokens78.71
NVIDIA GeForce RTX 5070OllamaMXFP415.4 tok/s15.4 tok/s14.6 GB65,536 tokens68.21
Apple M3OllamaMXFP48.4 tok/s8.4 tok/s13.0 GB8,192 tokens74.31

Benchmark runs

All 35 gpt-oss:20b runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

Is gpt-oss:20b good for coding?
In our benchmarks, gpt-oss:20b scores 63.3/100 for coding. It runs at about 77.7 tok/s, so if you want more speed, Nex-N2.5-mini-IQ3_XXS is faster (~91.4 tok/s) and still scores well for coding (81.6/100).
Is gpt-oss:20b good for agentic (tool-using) tasks?
In our benchmarks, gpt-oss:20b scores 77.7/100 for agentic workflows. It runs at about 77.7 tok/s, so if you want more speed, qwen3.8-flash-next-iq3_s is faster (~116.8 tok/s) and still scores well for agentic workflows (88.4/100).
How fast is gpt-oss:20b for local inference?
Across 35 community benchmark runs, gpt-oss:20b reaches up to 155.2 tok/s and averages 77.7 tok/s, with the fastest results on NVIDIA GeForce RTX 4070 Ti SUPER.
How much memory does gpt-oss:20b need?
The leanest observed configuration used about 382 MB of memory (quantizations tested: MXFP4, MXFP4_MOE).
Which tools have been used to run gpt-oss:20b?
Benchmarks were submitted using LM Studio, Ollama. Results are community-contributed and updated as new runs arrive.