Machine

RTX 2080 Ti + RTX A2000 12gb · Ryzen 7 5800X #0d84416a

39 runs of 23 models since Oct 11, 2026. Last run Oct 20, 2026.

ShareRedditX
39
runs
23
models
29
configs
7
configs run 2+ times

Hardware

GPU
NVIDIA GeForce RTX 2080 Ti + NVIDIA RTX A2000 12GB 23 GB
CPU
AMD Ryzen 7 5800X 8-Core Processor 8 cores
RAM
20 GB
OS
Debian GNU/Linux 13 (trixie)
Tools
llama.cpp 39
Client
0.4.96
All NVIDIA GeForce RTX 2080 Ti + NVIDIA RTX A2000 12GB benchmarks

Models on this machine

One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read4050607080901002050100tok/s (log scale) →quality →outliers sit at the edges

Medians of each model's best config, 23 models.

Best config per model

sort

Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.

nex-n2.5-mini
3 runs · 1 config
★ bestllama.cpp64k ctxthinking off
×3 runs
84.977.8–85.5
steady
65.9 tok/s
65.8–66.5
underdog-saluki
1 run · 1 config
★ bestllama.cpp8k ctxthinking default
80.4
1 rated run
24.9 tok/s
opus-v2
1 run · 1 config
★ bestllama.cpp32k ctxthinking off
79.3
1 rated run
73.6 tok/s
qwen38-27b-turbo
3 runs · 2 configs
★ bestllama.cpp8k ctxthinking default
×2 runs
77.877.7–78.0
steady
29.7 tok/s
29.5–29.8
gpt-oss-20b
1 run · 1 config
★ bestllama.cpp64k ctxthinking off
77.3
1 rated run
80.6 tok/s
qwen35-27b-opus
1 run · 1 config
★ bestllama.cpp32k ctxthinking off
76.9
1 rated run
17.5 tok/s
qwen3.8-35b-miniplus
2 runs · 2 configs
★ bestllama.cpp8k ctxthinking default
75.3
1 rated run
78.2 tok/s
lfm2.5-24b-a2b
1 run · 1 config
★ bestllama.cpp64k ctxthinking off
75.0
1 rated run
128 tok/s
ornith-heretic-mini
1 run · 1 config
★ bestllama.cpp8k ctxthinking default
75.0
1 rated run
71.3 tok/s
ornith15-heretic-mini
3 runs · 1 config
★ bestllama.cpp64k ctxthinking off
×3 runs
74.774.5–77.7
steady
72.7 tok/s
72.2–73.6

Compare with another machine

Run history