Benchmark result
llama3.1:8b — 55.2 tok/s
Measured with Ollama 0.11.4 on May 2, 2026.
What the model built
Open full screen →The coding scenario asks for a playable game in a single HTML file. This is exactly what the model returned, unedited; the frame only adds a line that tells this page how tall it is.
How this run compares
llama3.1:8b on other hardware
- 107.7tok/s43.4NVIDIA GeForce RTX 5060 Ti +1 more · Q4_K_M
- 74.0tok/s56.4Unknown hardware · Q4_K_M
- 57.5tok/s47.4Unknown hardware · Q4_K_M
- 55.2tok/s48.3Unknown hardware · Q4_K_Mthis run
- 53.5tok/s47.7Unknown hardware · Q4_K_M
Reproduce this run
toolOllama 0.11.4
modelllama3.1:8b (Q4_K_M)
context8,192
clientv0.4.20+97
Set those in Ollama, then:
llm-benchmark benchmark --model "llama3.1:8b" --tool "Ollama"The client prompts for context length and thinking mode, and for the KV cache dtype on Unsloth Studio. Sampling is left at the model default — the values above are what the tool reported using, not overrides the client sent.