Machine
RTX 3060 Laptop · Core i5-11400H @ 2.70GHz #caf47008
76 runs of 27 models since Oct 12, 2026. Last run Nov 15, 2026.
76
runs
27
models
69
configs
6
configs run 2+ times
Hardware
- GPU
- NVIDIA GeForce RTX 3060 Laptop GPU 6 GB
- CPU
- 11th Gen Intel(R) Core(TM) i5-11400H @ 2.70GHz 6 cores
- RAM
- 31 GB
- OS
- Ubuntu 26.04.1 LTS
- Tools
- Bionic 73 · Jan 3
- Client
- 0.4.98
Models on this machine
One dot per model, at its best config. Up is better answers, right is faster. Time to finish counts every token the model wrote, thinking included, so a model that talks a lot ends up further left.
Best trade-off: quality 60+, and nothing else here is both faster and betterOther models · dot size = number of runs
Medians of each model's best config, 25 models.
Best config per model
sort
Runs with the same model, quant, tool, context, thinking and KV cache count as one config. Numbers are the median of its runs, and each dot is one run on the 0–100 quality scale. ★ marks the best config with at least 2 rated runs.
configrunsqualityeach runspeed
qwen3.5-4b@q6_k
3 runs · 3 configs
Jan-v3.5-4B-Q4_K_XL
3 runs · 3 configs
google/gemma-4-e2b
4 runs · 4 configs
qwen3.8-4b-distill
3 runs · 3 configs
qwen3.5-4b
2 runs · 2 configs
ministral-3-8b-instruct-2512
2 runs · 2 configs
ministral-3-3b-reasoning-2512
1 run · 1 config
ministral-3-3b-reasoning-2512@q6_k
1 run · 1 config
nvidia/nemotron-3-nano-4b
4 runs · 3 configs
★ bestBionic8k ctxthinking default
×2 runs
54.852.1–57.6
steady
72.5 tok/s
60.9–84.2
granite-3.3-8b-instruct
3 runs · 3 configs
Compare with another machine
Run history
Nov 15, 2026
18:16phi-4-mini-instructBionic86.1 tok/s28.018:15phi-4-mini-instructBionic85.7 tok/s32.518:12phi-4-mini-instructBionic86.4 tok/s28.118:04phi-4-mini-instructBionic84.3 tok/s25.517:49muse-4bBionic59.2 tok/s2.6Oct 27, 2026
16:16Jan-v3.5-4B-Q4_K_XLJan73.4 tok/s68.216:09Jan-v3.5-4B-Q4_K_XLJan71.6 tok/s66.116:06Jan-v3.5-4B-Q4_K_XLJan75.3 tok/s66.8Oct 26, 2026
19:45ministral-1b-baseBionic64.8 tok/s0.619:45ministral-1b-baseBionic68.5 tok/s1.413:33smollm3-3bBionic74.2 tok/s35.413:26smollm3-3bBionic74.9 tok/s42.513:11granite-3.3-8b-instructBionic13.4 tok/s47.712:51granite-3.3-8b-instructBionic14.1 tok/s49.012:35granite-3.3-8b-instructBionic13.3 tok/s53.012:27granite-4.2-3bBionic38.9 tok/s52.112:01smollm2-1.7b-instructBionic126 tok/s26.711:59smollm2-1.7b-instructBionic118 tok/s26.311:57smollm2-1.7b-instructBionic126 tok/s23.0Oct 17, 2026
21:42hermes-3-llama-3.1-8bBionic18.8 tok/s48.321:36hermes-3-llama-3.1-8bBionic18.3 tok/s43.421:31ministral-3-8b-instruct-2512Bionic13.6 tok/s54.521:21ministral-3-8b-instruct-2512Bionic14.2 tok/s59.9Show all 76 runs ▾Show fewer ▴
Oct 14, 2026
03:21phi-3.1-mini-4k-instructBionic74.0 tok/s30.303:19phi-3.1-mini-4k-instruct×2Bionic76.3 tok/s29.603:14phi-3.1-mini-4k-instructBionic78.1 tok/s23.2Oct 13, 2026
18:15qwen3.5-4b@q6_kBionic29.6 tok/s75.217:45qwen3.8-2b-distillBionic109 tok/s30.917:10qwen3.8-2b-distillBionic113 tok/s28.617:08qwen3.8-2b-distillBionic116 tok/s24.917:06qwen3.8-2b-distillBionic115 tok/s25.412:28gemma-4-e4b-it-qatBionic22.1 tok/s52.806:44ministral-3-3b-reasoning-2512@q4_k_mBionic54.5 tok/s50.306:09ministral-3-3b-reasoning-2512@q6_kBionic20.7 tok/s56.704:18ministral-3-3b-reasoning-2512Bionic53.1 tok/s57.504:03ministral-1b-baseBionic226 tok/s1.104:02ministral-1b-baseBionic231 tok/s0.504:01ministral-1b-baseBionic230 tok/s0.604:01ministral-1b-baseBionic231 tok/s0.004:00ministral-1b-baseBionic234 tok/s0.003:45qwen3.8-4b-distillBionic40.9 tok/s61.903:14qwen3.8-4b-distillBionic43.6 tok/s58.6Oct 12, 2026
22:09qwen3.8-4b-distillBionic11.5 tok/s57.521:48qwen3.8-2b-distillBionic38.2 tok/s29.421:41qwen3.8-2b-distillBionic40.1 tok/s30.321:13eurollm-1.7b-instructBionic144 tok/s19.421:12eurollm-1.7b-instructBionic145 tok/s6.221:11eurollm-1.7b-instructBionic147 tok/s4.421:11eurollm-1.7bBionic150 tok/s1.121:09eurollm-1.7bBionic158 tok/s2.121:08eurollm-1.7bBionic148 tok/s1.021:08eurollm-1.7bBionic224 tok/s0.821:07eurollm-1.7bBionic152 tok/s4.920:30hermes-3-llama-3.1-8bBionic24.6 tok/s34.520:27hermes-3-llama-3.1-8bBionic24.6 tok/s32.520:26hermes-3-llama-3.1-8bBionic25.8 tok/s32.319:31qwen3.5-2bBionic133 tok/s39.719:25qwen3.5-2bBionic132 tok/s24.518:48qwen3.5-4bBionic70.6 tok/s61.918:18qwen3.5-4bBionic69.8 tok/s52.318:01hermes-3-llama-3.1-8bBionic18.2 tok/s41.117:21nemotron-3-nano-4bBionic84.5 tok/s55.311:06ministral-3-3b-instruct-2512Bionic74.0 tok/s44.811:03gemma-4-e2bBionic106 tok/s61.311:00gemma-4-e2bBionic105 tok/s58.610:57gemma-4-e2bBionic105 tok/s63.510:54gemma-4-e2bBionic106 tok/s66.310:33nemotron-3-nano-4bBionic60.9 tok/s52.110:24ministral-3-3b-instruct-2512Bionic93.7 tok/s45.410:11nemotron-3-nano-4bBionic83.5 tok/s43.110:07hermes-3-llama-3.1-8bBionic18.4 tok/s28.909:55nemotron-3-nano-4bBionic84.2 tok/s57.609:48ministral-3-3b-instruct-2512Bionic74.6 tok/s50.9