Machine

RTX 4060 Laptop · Core i7-14700HX #2d038440

156 runs of 29 models since Oct 29, 2026. Last run Nov 19, 2026.

ShareRedditX
156
runs
29
models
31
configs
19
configs run 2+ times

Hardware

GPU
NVIDIA GeForce RTX 4060 Laptop GPU 8 GB
CPU
Intel(R) Core(TM) i7-14700HX 20 cores
RAM
15 GB
OS
Windows 11 Home Single Language 26H2
Tools
llama.cpp 156
Client
0.4.98
All NVIDIA GeForce RTX 4060 Laptop GPU benchmarks

Models on this machine

One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read10305070902050100tok/s (log scale) →quality →outliers sit at the edges

Medians of each model's best config, 29 models.

Best config per model

sort

Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.

NVIDIA-Nemotron-3.5-Bolt-E4B-Q6_K-DFLASH-NVFP4
11 runs · 1 config
★ bestQ6_Kllama.cpp32k ctxthinking default
×11 runs
73.163.7–76.2
varies
66.6 tok/s
63.2–67.8
NVIDIA-Nemotron-3.5-Bolt-E4B-UD-Q4_K_XL
10 runs · 1 config
★ bestQ4_Kllama.cpp32k ctxthinking default
×10 runs
71.964.5–75.7
varies
46.6 tok/s
44.0–47.8
NVIDIA-Nemotron-3.5-Bolt-E4B-Q6_K-DFLASH-BF16
5 runs · 1 config
★ bestQ6_Kllama.cpp32k ctxthinking default
×5 runs
71.670.5–74.9
steady
61.0 tok/s
58.7–63.5
Qwen3.8-9B-Q4_K_M
5 runs · 1 config
★ bestQ4_K_Mllama.cpp32k ctxthinking default
×5 runs
71.470.6–77.7
steady
34.2 tok/s
33.8–35.7
NVIDIA-Nemotron-3.5-Bolt-E4B-Q6_K
10 runs · 1 config
★ bestQ6_Kllama.cpp32k ctxthinking default
×10 runs
71.064.7–76.7
varies
42.1 tok/s
41.0–43.0
Qwen3.5-4B-Q5_K_M
1 run · 1 config
★ bestQ5_K_Mllama.cpp32k ctxthinking default
69.4
1 rated run
47.7 tok/s
NVIDIA-Nemotron-3.5-Bolt-E4B-UD-Q4_K_XL-DFLASH-NVFP4
10 runs · 1 config
★ bestQ4_Kllama.cpp32k ctxthinking default
×10 runs
68.265.5–76.3
varies
60.9 tok/s
57.6–65.6
gemma-4-E4B-it-Q4_0
11 runs · 1 config
★ bestQ4_0llama.cpp32k ctxthinking default
×11 runs
67.956.4–72.8
varies1 slow run
89.2 tok/s
54.1–99.9
Spark-X2.6-4B-Q8_0
24 runs · 3 configs
★ bestQ8_0llama.cpp32k ctxthinking defaulteffort high
×10 runs
67.638.6–71.8
1 outlier
37.7 tok/s
33.9–41.4
One run of the best config scored 38.6, the other 9 sit between 60.9 and 71.8. The median isn't thrown off by it.
Qwen3.8-4B-Q5_K_M
5 runs · 1 config
★ bestQ5_K_Mllama.cpp32k ctxthinking default
×5 runs
66.056.6–70.2
varies
52.4 tok/s
50.6–55.1

Compare with another machine

Run history

Show all 156 runs ▾