Benchmark result

granite4.2:8b-q8_0 on AMD Radeon RX 7800 XT — 51.3 tok/s

Measured with Ollama 0.34.1 on September 18, 2026.

ShareReddit X

Reproduce this run

toolOllama 0.34.1

modelgranite4.2:8b-q8_0 (Q8_0)

context8,192

samplingtemperature 1 · top_p 0.95

clientv0.4.59+97

Set those in Ollama, then:

llm-benchmark benchmark --model "granite4.2:8b-q8_0" --tool "Ollama"

The client prompts for context length and thinking mode, and for the KV cache dtype on Unsloth Studio. Sampling is left at the model default — the values above are what the tool reported using, not overrides the client sent.