Machine
RTX 4070 · Ryzen 9 7900X #0b901106
283 runs of 47 models since Sep 18, 2026. Last run Nov 2, 2026.
283
runs
47
models
177
configs
49
configs run 2+ times
Hardware
- GPU
- NVIDIA GeForce RTX 4070 12 GB
- CPU
- AMD Ryzen 9 7900X 12-Core Processor 12 cores
- RAM
- 63 GB
- OS
- Windows 11 Education 26H2
- Tools
- llama.cpp 142 · Unsloth Studio 131 · OpenAI-compatible 8 · Strata 2
- Client
- 0.4.98
Models on this machine
One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.
Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
Medians of each model's best config, 45 models.
Best config per model
sort
Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.
configrunsqualityeach runspeed
swift-iq2_xs
2 runs · 1 config
★ bestStrata32k ctxthinking on
×2 runs
87.987.3–88.5
steady
91.5 tok/s
90.1–92.9
peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP
5 runs · 4 configs
★ bestUD-IQ4_XSUnsloth Studio64k ctxthinking oneffort mediumKV q4_0
×2 runs
85.483.9–86.9
steady
78.9 tok/s
76.3–81.5
Ternary-Bonsai-2-27B-PTQ1_0
5 runs · 3 configs
★ bestQ1_0OpenAI-compatible64k ctxthinking default
×2 runs
84.279.9–88.6
varies
55.5 tok/s
55.3–55.8
ukisai/Swift-Bonsai-2-GGUF
3 runs · 2 configs
★ bestTQ1_0llama.cpp128k ctxthinking oneffort medium
×2 runs
84.182.1–86.1
steady
65.2 tok/s
65.2–65.3
prism-ml/Ternary-Bonsai-2-27B-gguf
15 runs · 12 configs
★ bestPTQ1_0llama.cpp64k ctxthinking default
×2 runs
83.080.0–85.9
steady
60.7 tok/s
60.0–61.5
ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
6 runs · 4 configs
★ bestllama.cpp32k ctxthinking oneffort xhigh
×3 runs
81.976.9–87.7
varies
38.8 tok/s
38.5–39.8
protoLabsAI/Ornith-1.5-9B-MTP-GGUF
4 runs · 4 configs
unsloth/Ornith-1.0-9B-GGUF
5 runs · 4 configs
★ bestUD-Q4_K_XLUnsloth Studio32k ctxthinking defaultKV f16
×2 runs
75.774.2–77.2
steady
63.3 tok/s
59.1–67.4
unsloth/gemma-4-12B-it-qat-GGUF
5 runs · 5 configs
mistralai/Ministral-3-8B-Instruct-2512-GGUF
4 runs · 3 configs
★ bestQ4_K_Mllama.cpp64k ctxthinking default
×2 runs
72.871.8–73.8
steady
66.0 tok/s
63.9–68.2
Compare with another machine
Run history
Nov 2, 2026
07:36swift-iq2_xs×2Strata91.5 tok/s87.9Nov 1, 2026
16:09Qwen3.8-27B-GSQ-RCO-GGUFllama.cpp39.8 tok/s76.915:36Qwen3.8-27B-GSQ-RCO-GGUFllama.cpp41.6 tok/s84.714:52Qwen3.8-27B-GSQ-RCO-GGUFllama.cpp39.6 tok/s82.014:33Qwen3.8-27B-GSQ-RCO-GGUF×2llama.cpp38.6 tok/s84.813:06Qwen3.8-27B-GSQ-RCO-GGUFUnsloth Studio41.8 tok/s74.2Oct 29, 2026
22:01LFM3-1.7B-GGUFUnsloth Studio250 tok/s55.220:48LFM3-1.7B-GGUF×2Unsloth Studio252 tok/s59.318:30Ling-3.0-tiny-GGUF×2Unsloth Studio191 tok/s61.108:53Swift-Bonsai-2-GGUF:TQ1_0llama.cpp63.7 tok/s85.107:48Swift-Bonsai-2-GGUF:TQ1_0×2llama.cpp65.2 tok/s84.1Oct 28, 2026
11:49NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF×2Unsloth Studio134 tok/s71.311:42NVIDIA-Nemotron-3.5-Bolt-E4B-GGUFUnsloth Studio129 tok/s64.011:38NVIDIA-Nemotron-3.5-Bolt-E4B-GGUFUnsloth Studio87.9 tok/s69.3Oct 24, 2026
16:04Cyber-Tiel-Coder-35B-A3B-GGUF-MTPUnsloth Studio76.3 tok/s86.915:38Cyber-Tiel-Coder-35B-A3B-GGUF-MTPUnsloth Studio76.1 tok/s83.515:29Cyber-Tiel-Coder-35B-A3B-GGUF-MTPUnsloth Studio81.5 tok/s83.914:51Cyber-Tiel-Coder-35B-A3B-GGUF-MTPUnsloth Studio82.3 tok/s82.614:32Cyber-Tiel-Coder-35B-A3B-GGUF-MTPUnsloth Studio53.9 tok/s87.4Show all 283 runs ▾Show fewer ▴
Oct 19, 2026
22:19Ternary-Bonsai-2-27B-gguf:TQ1_0llama.cpp57.3 tok/s81.221:53Ternary-Bonsai-2-27B-gguf:TQ1_0llama.cpp58.2 tok/s83.621:31Ternary-Bonsai-2-9B-gguf:Q2_0×4llama.cpp146 tok/s53.021:12Ternary-Bonsai-2-9B-gguf:PTQ1_0llama.cpp165 tok/s63.221:06Ternary-Bonsai-2-4B-gguf:PTQ1_0×2llama.cpp252 tok/s53.320:58Ternary-Bonsai-2-4B-gguf:Q2_0×3llama.cpp222 tok/s52.520:40Ternary-Bonsai-2-4B-gguf:PQ2_0llama.cpp210 tok/s54.9Oct 16, 2026
21:08Ternary-Bonsai-2-2B-gguf:PQ2_0×2llama.cpp367 tok/s28.521:05Ternary-Bonsai-2-2B-gguf:PQ2_0×3llama.cpp388 tok/s29.221:02Ternary-Bonsai-2-2B-gguf:PQ2_0×3llama.cpp375 tok/s38.220:57Ternary-Bonsai-2-4B-gguf:PQ2_0×7llama.cpp229 tok/s49.820:27Ternary-Bonsai-2-9B-gguf:PQ2_0×2llama.cpp154 tok/s56.020:13Ternary-Bonsai-2-9B-gguf:PQ2_0llama.cpp154 tok/s57.620:12Ternary-Bonsai-2-9B-gguf:PQ2_0×11llama.cpp184 tok/s57.416:19Ternary-Bonsai-2-9B-gguf:PQ2_0llama.cpp187 tok/s52.716:16Ternary-Bonsai-2-2B-gguf:PQ2_0×3llama.cpp379 tok/s33.315:36Ternary-Bonsai-2-4B-gguf:PQ2_0×5llama.cpp276 tok/s48.315:18Ternary-Bonsai-2-9B-gguf:PQ2_0llama.cpp192 tok/s56.215:17Ternary-Bonsai-2-9B-gguf:PQ2_0×6llama.cpp183 tok/s58.114:48Ternary-Bonsai-2-9B-gguf:PTQ1_0×3llama.cpp146 tok/s53.710:42Ternary-Bonsai-2-4B-ggufUnsloth Studio156 tok/s56.109:51Ternary-Bonsai-2-2B-ggufUnsloth Studio231 tok/s31.008:13K2-Horizon-3.7B-GGUFUnsloth Studio102 tok/s56.307:58Sharp-MiniCPM5-2B-GGUF×2OpenAI-compatible158 tok/s56.5Oct 15, 2026
21:57Sharp-MiniCPM5-2B-GGUF×2OpenAI-compatible156 tok/s50.321:45Sharp-MiniCPM5-2B-GGUF:Q6_K_XLllama.cpp157 tok/s54.521:38Sharp-MiniCPM5-2B-GGUFUnsloth Studio144 tok/s51.321:35Sharp-Spark-X2.5-4B-GGUF×2Unsloth Studio89.0 tok/s68.620:49K2-Horizon-7B-GGUFUnsloth Studio68.1 tok/s70.920:45K2-Horizon-7B-GGUFUnsloth Studio68.5 tok/s67.519:55K2-Horizon-7B-GGUFUnsloth Studio71.9 tok/s66.007:18K2-Horizon-0.9B-GGUFUnsloth Studio301 tok/s34.007:09MiniCPM5-1B-GGUFUnsloth Studio236 tok/s12.7Oct 14, 2026
22:16MiniCPM5-2B-GGUF×3llama.cpp207 tok/s47.321:52MiniCPM5-2B-GGUFUnsloth Studio175 tok/s44.421:45MiniCPM5-2B-GGUFUnsloth Studio168 tok/s47.921:41Sharp-MiniCPM5-2B-GGUFUnsloth Studio143 tok/s52.621:37Sharp-MiniCPM5-2B-GGUFUnsloth Studio138 tok/s50.521:32Sharp-MiniCPM5-2B-GGUF×3Unsloth Studio136 tok/s57.111:19LFM2.5-230M-GGUFUnsloth Studio901 tok/s12.210:25K2-Horizon-0.9B-GGUFUnsloth Studio260 tok/s20.809:52K2-Horizon-0.9B-GGUFUnsloth Studio323 tok/s29.809:51K2-Horizon-0.9B-GGUFUnsloth Studio323 tok/s37.408:51K2-Horizon-0.9B-GGUFUnsloth Studio252 tok/s31.308:19K2-Horizon-0.9B-GGUFUnsloth Studio261 tok/s25.107:49K2-Horizon-0.9B-GGUFUnsloth Studio270 tok/s27.1Oct 13, 2026
21:23Mellum2.1-12B-A2.5B-Thinking-GGUF:Q4_K_M×5llama.cpp166 tok/s67.917:41Qwen3.5-0.8B-MTP-GGUF:Q8_K_XLllama.cpp198 tok/s18.317:04Mellum2.1-12B-A2.5B-Thinking-GGUFOpenAI-compatible180 tok/s62.707:56Ornith-1.5-9B-GGUF:Q4_K_M×2llama.cpp75.2 tok/s71.6Oct 12, 2026
22:26Ministral-3-8B-Instruct-2512-GGUF:Q4_K_M×2llama.cpp66.0 tok/s72.822:08Ministral-3-8B-Instruct-2512-GGUF:Q4_K_Mllama.cpp56.3 tok/s69.221:56Mellum2.1-12B-A2.5B-Thinking-GGUF:Q4_K_M×2llama.cpp109 tok/s67.521:27Mellum2.1-12B-A2.5B-Thinking-GGUF:MXFP4_MOEllama.cpp166 tok/s69.621:24Mellum2.1-12B-A2.5B-Thinking-GGUF:Q4_K_Mllama.cpp177 tok/s68.321:12Mellum2.1-12B-A2.5B-Thinking-GGUFUnsloth Studio44.8 tok/s65.421:00Mellum2.1-12B-A2.5B-Thinking-GGUFUnsloth Studio37.7 tok/s62.320:41Mellum2.1-12B-A2.5B-Thinking-GGUFUnsloth Studio152 tok/s63.420:31Mellum2.1-12B-A2.5B-Thinking-GGUFUnsloth Studio173 tok/s66.020:22Mellum2.1-12B-A2.5B-Thinking-GGUFUnsloth Studio167 tok/s69.0Oct 10, 2026
22:31Ternary-Bonsai-2-27B-gguf:PTQ1_0llama.cpp60.0 tok/s80.022:23Ternary-Bonsai-2-27B-gguf:PTQ1_0llama.cpp55.1 tok/s84.121:48Ornith-1.5-9B-MTP-GGUF:IQ4_XSllama.cpp83.5 tok/s76.121:37Ornith-1.5-9B-GGUF:Q4_K_Mllama.cpp75.3 tok/s63.021:28Ornith-1.0-9B-GGUF:Q5_K_XLllama.cpp46.0 tok/s70.821:20Ornith-1.5-9B-GGUF:IQ4_XS×2llama.cpp82.0 tok/s61.220:24Ornith-1.5-9B-GGUF:IQ4_XSllama.cpp46.8 tok/s61.020:19Ternary-Bonsai-8B-gguf:Q2_0llama.cpp151 tok/s47.220:13Ternary-Bonsai-8B-gguf:Q2_0llama.cpp149 tok/s56.320:07Ternary-Bonsai-8B-gguf:Q2_0llama.cpp153 tok/s41.9Oct 8, 2026
17:33Ternary-Bonsai-2-27B-PTQ1_0×2OpenAI-compatible55.5 tok/s84.209:13Ternary-Bonsai-2-27B-PTQ1_0OpenAI-compatible57.5 tok/s78.908:07Ternary-Bonsai-2-27B-PTQ1_0×2llama.cpp42.5 tok/s80.4Oct 7, 2026
12:41gemma-4-12B-it-qat-GGUFUnsloth Studio74.0 tok/s71.710:18Qwen3.5-9B-MTP-GGUFUnsloth Studio63.0 tok/s68.210:09Qwen3.5-4B-MTP-GGUFUnsloth Studio139 tok/s70.510:02Sharp-Spark-X2.5-4B-GGUFUnsloth Studio95.5 tok/s71.608:31Ministral-3-8B-Instruct-2512-GGUFUnsloth Studio68.1 tok/s61.8Sep 29, 2026
22:42Ornith-1.5-9B-GGUFUnsloth Studio63.7 tok/s54.822:21Ornith-1.5-9B-MTP-GGUFUnsloth Studio92.5 tok/s78.122:09Ornith-1.5-9B-GGUFUnsloth Studio80.5 tok/s76.921:50Ornith-1.5-9B-GGUFUnsloth Studio66.1 tok/s58.721:20Ornith-1.5-9B-GGUFUnsloth Studio58.4 tok/s63.821:02Ornith-1.5-9B-GGUFUnsloth Studio56.6 tok/s56.220:35Ornith-1.0-9B-GGUFUnsloth Studio60.9 tok/s76.720:25LFM2.5-350M-GGUFUnsloth Studio780 tok/s10.020:22LFM2.5-350M-GGUFUnsloth Studio749 tok/s14.520:20LFM2.5-230M-GGUFUnsloth Studio689 tok/s13.520:16LFM2.5-230M-GGUFUnsloth Studio905 tok/s16.420:14functiongemma-270m-it-GGUFUnsloth Studio498 tok/s0.620:09Qwen3.5-4B-MTP-GGUFUnsloth Studio136 tok/s67.920:05Qwen3.5-4B-MTP-GGUFUnsloth Studio142 tok/s56.920:02Qwen3.5-4B-MTP-GGUFUnsloth Studio150 tok/s70.519:57Qwen3.5-4B-MTP-GGUFUnsloth Studio123 tok/s57.619:51Qwen3.5-4B-GGUFUnsloth Studio105 tok/s65.9Sep 28, 2026
21:28Qwen3.5-4B-MTP-GGUFUnsloth Studio108 tok/s67.521:16Qwen3.5-4B-MTP-GGUFUnsloth Studio21.9 tok/s69.620:57Qwen3.5-4B-MTP-GGUF×2Unsloth Studio111 tok/s68.920:49Qwen3.5-4B-MTP-GGUF×2Unsloth Studio109 tok/s67.120:40Qwen3.5-4B-MTP-GGUFUnsloth Studio117 tok/s64.720:35Qwen3.5-4B-MTP-GGUF×4Unsloth Studio117 tok/s62.618:12Qwen3.5-2B-MTP-GGUFUnsloth Studio141 tok/s42.617:34Qwen3.5-2B-MTP-GGUFUnsloth Studio168 tok/s36.817:31Qwen3.5-2B-MTP-GGUFUnsloth Studio158 tok/s49.117:26Qwen3.5-2B-MTP-GGUFUnsloth Studio168 tok/s37.017:22Qwen3.5-2B-MTP-GGUFUnsloth Studio168 tok/s37.517:20Qwen3.5-2B-MTP-GGUFUnsloth Studio169 tok/s51.017:18Qwen3.5-2B-MTP-GGUFUnsloth Studio169 tok/s50.117:07Qwen3.5-2B-MTP-GGUFUnsloth Studio168 tok/s38.707:38Ornith-1.5-9B-GGUFUnsloth Studio62.3 tok/s73.607:12Ornith-1.5-9B-GGUFUnsloth Studio87.2 tok/s58.306:58Ornith-1.5-9B-GGUFUnsloth Studio49.7 tok/s62.206:12LFM2.5-8B-A1B-GGUFUnsloth Studio260 tok/s52.706:06MiniCPM5-2B-GGUFUnsloth Studio166 tok/s47.4Sep 27, 2026
22:45Ternary-Bonsai-2-27B-ggufUnsloth Studio47.6 tok/s77.922:38MiniCPM5-2B-GGUFUnsloth Studio235 tok/s31.522:30NVIDIA-Nemotron-3-Nano-4B-GGUFUnsloth Studio95.3 tok/s39.422:27gemma-4-E4B-it-qat-mobile-GGUFUnsloth Studio77.4 tok/s29.322:19gemma-4-12B-it-qat-GGUFUnsloth Studio82.0 tok/s72.322:02gemma-4-12B-it-qat-GGUFUnsloth Studio50.4 tok/s73.821:21Qwen3.5-0.8B-MTP-GGUFUnsloth Studio550 tok/s9.821:06Qwen3.5-0.8B-MTP-GGUFUnsloth Studio441 tok/s15.720:45Ternary-Bonsai-2-27B-ggufUnsloth Studio45.3 tok/s84.520:18Ternary-Bonsai-2-27B-ggufUnsloth Studio61.7 tok/s60.519:49Ornith-1.5-9B-MTP-GGUFUnsloth Studio88.7 tok/s56.818:54Ornith-1.5-9B-MTP-GGUFUnsloth Studio83.7 tok/s69.116:41Ternary-Bonsai-2-27B-ggufUnsloth Studio45.9 tok/s81.712:32Ternary-Bonsai-2-27B-ggufUnsloth Studio45.1 tok/s72.712:07Ternary-Bonsai-2-27B-ggufUnsloth Studio46.4 tok/s53.411:51Ternary-Bonsai-2-27B-ggufUnsloth Studio47.9 tok/s40.811:09Qwen3.5-4B-MTP-GGUFUnsloth Studio146 tok/s70.111:03Qwen3.5-4B-MTP-GGUFUnsloth Studio121 tok/s57.609:50Qwen3.5-4B-MTP-GGUFUnsloth Studio25.5 tok/s58.108:28Qwen3.5-4B-MTP-GGUFUnsloth Studio123 tok/s53.808:11Qwen3.5-9B-MTP-GGUFUnsloth Studio102 tok/s69.808:06Qwen3.5-9B-MTP-GGUFUnsloth Studio97.7 tok/s67.108:04Qwen3.5-9B-MTP-GGUFUnsloth Studio105 tok/s61.706:45Qwen3.8-27B-GGUFUnsloth Studio41.0 tok/s43.205:57Qwen3.8-27B-GGUFUnsloth Studio41.6 tok/s56.9Sep 26, 2026
22:54Qwen3.8-27B-GGUFUnsloth Studio41.7 tok/s51.722:45Qwen3.5-9B-MTP-GGUFUnsloth Studio105 tok/s71.622:39Qwen3.5-9B-MTP-GGUFUnsloth Studio111 tok/s73.322:10Qwen3.5-9B-MTP-GGUFUnsloth Studio17.6 tok/s66.722:00Ornith-1.0-9B-GGUF×2Unsloth Studio63.3 tok/s75.721:41Qwen3.5-0.8B-MTP-GGUFUnsloth Studio240 tok/s23.721:37LFM2.5-VL-1.6B-GGUFUnsloth Studio440 tok/s24.821:33MiniCPM5-2B-GGUFUnsloth Studio155 tok/s50.721:29LFM2.5-1.2B-Instruct-GGUFUnsloth Studio333 tok/s44.921:27LFM2.5-1.2B-Instruct-GGUFUnsloth Studio335 tok/s31.621:25LFM2.5-1.2B-Thinking-GGUFUnsloth Studio335 tok/s31.821:21MiniCPM5-2B-GGUFUnsloth Studio129 tok/s40.4Sep 18, 2026
19:30LFM2.5-1.2B-Instruct-GGUFllama.cpp336 tok/s30.119:28LFM2.5-1.2B-Thinking-GGUFllama.cpp314 tok/s30.219:26LFM2.5-1.2B-Thinking-GGUFllama.cpp319 tok/s31.219:23LFM2.5-VL-1.6B-GGUF×2llama.cpp1053 tok/s18.417:04unknownllama.cpp41.0 tok/s66.016:35Qwen3.8-27B-GGUF×4llama.cpp39.6 tok/s53.514:18NVIDIA-Nemotron-3-Nano-4B-GGUFllama.cpp95.0 tok/s51.314:15NVIDIA-Nemotron-3-Nano-4B-GGUFllama.cpp91.9 tok/s41.614:13NVIDIA-Nemotron-3-Nano-4B-GGUFllama.cpp91.6 tok/s39.514:08Qwen3.5-0.8B-MTP-GGUFllama.cpp237 tok/s26.514:06Qwen3.5-0.8B-MTP-GGUFllama.cpp241 tok/s22.114:02Qwen3.5-9B-MTP-GGUF×2llama.cpp99.3 tok/s69.013:46LFM2.5-1.2B-Thinking-GGUFllama.cpp309 tok/s29.113:44LFM2.5-1.2B-Thinking-GGUF×2llama.cpp331 tok/s33.513:37gemma-4-12B-it-qat-GGUFllama.cpp50.1 tok/s69.713:29gemma-4-12B-it-qat-GGUFllama.cpp51.4 tok/s67.813:23LFM2.5-1.2B-Instruct-GGUFllama.cpp337 tok/s32.713:13Ornith-1.0-9B-GGUFllama.cpp60.1 tok/s72.712:59LFM2.5-8B-A1B-GGUFllama.cpp240 tok/s44.812:45Qwen3.8-27B-GGUFllama.cpp42.1 tok/s76.012:26gemma-4-E4B-it-qat-mobile-GGUFllama.cpp72.6 tok/s23.412:19gemma-4-E4B-it-qat-mobile-GGUFllama.cpp73.6 tok/s29.512:10LFM2.5-1.2B-Thinking-GGUFllama.cpp304 tok/s27.812:08LFM2.5-1.2B-Thinking-GGUFllama.cpp330 tok/s32.312:05LFM2.5-1.2B-Instruct-GGUF×2llama.cpp382 tok/s36.912:00LFM2.5-8B-A1B-GGUFllama.cpp241 tok/s52.611:46LFM2.5-8B-A1B-Q4_K_Mllama.cpp276 tok/s50.911:42LFM2.5-8B-A1B-Q4_K_M×2llama.cpp284 tok/s47.811:25gpt-oss-20b-UD-Q4_K_XLllama.cpp117 tok/s41.711:16LFM2.5-8B-A1B-Q4_K_Mllama.cpp282 tok/s55.0