Machine

INTEL R Arc Tm 140v 16gb · Core Ultra 7 268V #e13c4a75

44 runs of 25 models since Sep 18, 2026. Last run Nov 3, 2026.

ShareRedditX
44
runs
25
models
39
configs
4
configs run 2+ times

Hardware

GPU
Intel(R) Arc(TM) 140V GPU (16GB)
CPU
Intel(R) Core(TM) Ultra 7 268V 8 cores
RAM
31 GB
OS
Windows 11 Pro 25H2
Tools
Unsloth Studio 27 · llama.cpp 15 · ovms 2
Client
0.4.98
All Intel(R) Arc(TM) 140V GPU (16GB) benchmarks

Models on this machine

One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read020406080100102050100200tok/s (log scale) →quality →

Medians of each model's best config, 24 models.

Best config per model

sort

Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.

protoLabsAI/Ornith-1.5-9B-MTP-GGUF
2 runs · 2 configs
★ bestQ4_K_MUnsloth Studio64k ctxthinking onKV q8_0
77.0
1 rated run
18.0 tok/s
bartowski/Mellum2.1-12B-A2.5B-Thinking-GGUF
1 run · 1 config
★ bestIQ4_NLUnsloth Studio256k ctxthinking onKV q4_0
74.8
1 rated run
30.7 tok/s
unsloth/Qwen3.5-9B-GGUF
2 runs · 2 configs
★ bestUD-Q4_K_XLUnsloth Studio64k ctxthinking onKV q8_0
71.8
1 rated run
13.8 tok/s
JetBrains/Mellum2.1-12B-A2.5B-Thinking-GGUF
1 run · 1 config
★ bestQ4_K_MUnsloth Studio256k ctxthinking onKV q4_0
67.7
1 rated run
24.4 tok/s
prism-ml/Ternary-Bonsai-2-27B-gguf
2 runs · 2 configs
★ bestPTQ1_0Unsloth Studio16k ctxthinking oneffort lowKV q4_0
65.5
1 rated run
9.8 tok/s
prism-ml/Ternary-Bonsai-2-4B-gguf
3 runs · 3 configs
★ bestQ2_0Unsloth Studio256k ctxthinking onKV q4_0
58.8
1 rated run
40.2 tok/s
LiquidAI/LFM3-1.7B-GGUF
1 run · 1 config
★ bestQ4_0Unsloth Studio128k ctxthinking onKV q4_0
58.4
1 rated run
58.0 tok/s
bartowski/MiniCPM5-2B-GGUF
1 run · 1 config
★ bestUnsloth Studio64k ctxthinking default
53.7
1 rated run
23.2 tok/s
peculiar-ragdoll/Sharp-MiniCPM5-2B-GGUF
2 runs · 1 config
★ bestQ4_K_XLUnsloth Studio256k ctxthinking onKV q4_0
×2 runs
51.550.3–52.8
steady
37.2 tok/s
35.9–38.5
unsloth/Qwen3.5-2B-MTP-GGUF
1 run · 1 config
★ bestllama.cpp8k ctxthinking default
50.7
1 rated run
39.8 tok/s

Compare with another machine

Run history

Show all 44 runs ▾