Machine

2× Tesla V100 Pcie 32gb · Xeon W-2133 #48decc36

117 runs of 47 models since Nov 1, 2026. Last run Nov 10, 2026.

ShareRedditX
117
runs
47
models
63
configs
34
configs run 2+ times

Hardware

GPU
2× Tesla V100-PCIE-32GB 64 GB
CPU
Intel(R) Xeon(R) W-2133 CPU @ 3.60GHz 6 cores
RAM
46 GB
OS
Arch Linux
Tools
llama.cpp 114 · OpenAI-compatible 2 · vLLM 1
Client
0.4.99
All 2× Tesla V100-PCIE-32GB benchmarks

Models on this machine

One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.

Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
below 20 tok/s: slower than you read204060801002050100200tok/s (log scale) →quality →

Medians of each model's best config, 47 models.

Best config per model

sort

Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.

Qwen3.8-27B-GSQ-RCO
2 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
87.686.2–88.9
steady
41.1 tok/s
39.0–43.1
Arete-27B_t1p95k20m0
2 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
86.586.4–86.6
steady
37.2 tok/s
37.2–37.2
Cyber-Tiel_t06p95k20m0
2 runs · 1 config
★ bestllama.cpp32k ctxthinking default
×2 runs
86.184.9–87.2
steady
106 tok/s
105–107
Sabi-Noema_t1p95k20m0
2 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
85.985.7–86.2
steady
58.9 tok/s
58.3–59.4
Qwen3.8-27B-GSQ-RCO_t1p95k20m0
2 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
85.884.1–87.6
steady
41.4 tok/s
41.1–41.6
Swift-1.5-Uncensored
6 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×6 runs
85.680.7–88.3
steady
60.8 tok/s
42.7–69.1
Cyber-Tiel
5 runs · 2 configs
★ bestllama.cpp32k ctxthinking default
×4 runs
85.183.0–86.4
steady
107 tok/s
106–109
Swift-1.5-Uncensored_t1p95k20m0
2 runs · 1 config
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
85.183.8–86.5
steady
60.1 tok/s
59.8–60.4
GRM-3.2-Sky
4 runs · 1 config
★ bestllama.cpp32k ctxthinking default
×4 runs
84.683.1–86.2
steady
99.0 tok/s
94.4–99.5
Thinklite-27-GGUF_t1p95k20m0
3 runs · 2 configs
★ bestllama.cpp32k ctxthinking defaulteffort xhigh
×2 runs
84.680.6–88.6
steady
48.4 tok/s
48.3–48.5

Compare with another machine

Run history

Nov 10, 2026
20:09Qwen-MidTemp229 tok/s32.020:07Qwen-MidTemp238 tok/s19.520:06Qwen-LowTemp219 tok/s21.420:03Qwen-LowTemp232 tok/s28.919:35Thinklite-27-GGUF_t1p95k20m0×248.4 tok/s84.619:12Terminal-RSI_t06p95k20m0×266.7 tok/s76.219:04Swift-1.5-Uncensored_t1p95k20m0×260.1 tok/s85.118:37Sage-A1.5_t1p95k20m0P15×293.0 tok/s75.918:19Sabi-Noema_t1p95k20m0×258.9 tok/s85.917:57Qwen3.8-27B-GSQ-RCO_t1p95k20m0×241.4 tok/s85.817:21Qwen3-Coder-Next_t1p95k40m0×281.5 tok/s78.517:11Qwen-Turbo-Uncensored_t1p95k20m0×239.7 tok/s70.716:52Qwen-EfficientThink_t1p95k20m0×238.5 tok/s82.316:25Nemotron-3.5-Lightning_t1p95k40m05×2126 tok/s75.616:14Nanbeige4.3_t1p95k0m0×230.9 tok/s72.515:28Muse-Glimmer-30B_t1p95k64m05×240.6 tok/s84.515:14Muse-Glimmer-30B-Heretic_t1p95k64m05×252.3 tok/s78.415:01Kwaipilot-KAT-Coder_t1p95k20m0×299.9 tok/s80.914:49Gemma4-31B-IT_t1p95k64m05×251.4 tok/s75.114:40GRM-3.2-Sky_t1p95k20m0×299.8 tok/s78.414:31GLM-4.7-Flash-REAP_t02p95k50m01D11×249.7 tok/s65.614:18Flint_t1p95k20m0×288.9 tok/s75.514:04Cyber-Tiel_t06p95k20m0×2106 tok/s86.113:54Arete-27B_t1p95k20m0×237.2 tok/s86.513:13Apex-35B-V1.0_t1p95k20m0×299.3 tok/s56.612:49Qwen-HighTemp237 tok/s20.112:44Qwen-LowTemp×2213 tok/s26.012:34Qwen-HighTemp×4235 tok/s25.712:06Qwen-LowTemp×2232 tok/s29.012:00Qwen-LowTemp×2222 tok/s19.311:54Qwen-LowTemp×2230 tok/s23.911:52Qwen-HighTemp235 tok/s24.311:50Qwen-HighTemp×3236 tok/s26.311:10Thinklite-27-GGUF_t1p95k20m049.0 tok/s70.410:24Kwaipilot-KAT-Coder_t1p95k20m0×3101 tok/s76.909:03Kwaipilot-KAT-Coder_t1p95k20m0×3101 tok/s78.300:54Apex-35B-V1.0_t1p95k20m098.8 tok/s57.9
Show all 117 runs ▾