Benchmark result

granite4.2:30b-q2_K on AMD Radeon RX 7800 XT — 27.7 tok/s

Measured with Ollama 0.34.1 on September 18, 2026.

ShareRedditX

Reproduce this run

toolOllama 0.34.1
modelgranite4.2:30b-q2_K (Q2_K)
context8,192
samplingtemperature 1 · top_p 0.95
clientv0.4.59+97

Set those in Ollama, then:

llm-benchmark benchmark --model "granite4.2:30b-q2_K" --tool "Ollama"

The client prompts for context length and thinking mode, and for the KV cache dtype on Unsloth Studio. Sampling is left at the model default — the values above are what the tool reported using, not overrides the client sent.