Machine

RTX 4070 · Core i5-13400F #024030e9

32 runs of 15 models since Nov 13, 2026. Last run Nov 20, 2026.

ShareRedditX
32
runs
15
models
22
configs
7
configs run 2+ times

Hardware

GPU
NVIDIA GeForce RTX 4070 12 GB
CPU
13th Gen Intel(R) Core(TM) i5-13400F 10 cores
RAM
63 GB
OS
Windows 11 Pro 26H2
Tools
llama.cpp 31 · Strata 1
Client
0.4.99
All NVIDIA GeForce RTX 4070 benchmarks

Models on this machine

One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read4050607080901002050100tok/s (log scale) →quality →

Medians of each model's best config, 15 models.

Best config per model

sort

Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.

qwen3.8-flash-next-iq3_xxs
3 runs · 3 configs
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
87.7
1 rated run
48.2 tok/s
ornith-1.5-35b-a3b-apex-mtp-quality
3 runs · 1 config
★ bestllama.cpp64k ctxthinking default
×3 runs
86.385.3–88.0
steady
104 tok/s
102–104
cyber-tiel-coder-35b-a3b-mtp-ud-q5_k_xl
5 runs · 2 configs
★ bestQ5_Kllama.cpp64k ctxthinking default
×4 runs
85.683.3–87.9
steady
104 tok/s
90.6–112
ornith-1.5-35b-a3b-apex-mtp-i-quality
2 runs · 1 config
★ bestllama.cpp64k ctxthinking default
×2 runs
85.484.8–86.0
steady
105 tok/s
104–106
default
4 runs · 3 configs
★ bestllama.cpp64k ctxthinking oneffort medium
×2 runs
85.182.9–87.4
steady
68.9 tok/s
66.7–71.0
cyber-tiel-coder-35b-a3b-mtp-ud-q6_k_xl
2 runs · 1 config
★ bestQ6_Kllama.cpp64k ctxthinking default
×2 runs
84.082.8–85.2
steady
92.4 tok/s
91.7–93.0
cyber-tiel-coder-35b-a3b-mtp-ud-q4_k_xl
1 run · 1 config
★ bestQ4_Kllama.cpp64k ctxthinking default
82.4
1 rated run
122 tok/s
ornith-1.5-35b-a3b-crack-q4_k_m
2 runs · 2 configs
★ bestQ4_K_Mllama.cpp32k ctxthinking default
81.2
1 rated run
102 tok/s
ornith-1.5-35b-a3b-apex-i-miniplus-v2.1
1 run · 1 config
★ bestllama.cpp64k ctxthinking default
80.7
1 rated run
138 tok/s
qwen3.6-35b-a3b-uncensored-hauhaucs-aggressive-q4_k_m
1 run · 1 config
★ bestQ4_K_Mllama.cpp64k ctxthinking default
79.6
1 rated run
124 tok/s

Compare with another machine

Run history

Show all 32 runs ▾