Benchmark result
Qwen3.8-27B-UD-Q6_K_XL on NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition — 80.5 tok/s
Measured with vLLM on August 31, 2026.
What the model built
Open full screen →The coding scenario asks for a playable game in a single HTML file. This is exactly what the model returned, unedited.
How this run compares
3rd fastest of 4 runs of this model on NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · median 84.4 tok/s.
sort
- 190.1tok/s80.2vLLM · Q6_K
- 288.2tok/s62.7vLLM · Q6_K
- 380.5tok/s86.3vLLM · Q6_Kthis run
- 478.3tok/s88.6vLLM · Q6_K
Reproduce this run
toolvLLM
modelQwen3.8-27B-UD-Q6_K_XL (Q6_K)
context65,536
thinkingon
clientv0.4.46+97
Set those in vLLM, then:
llm-benchmark benchmark --model "Qwen3.8-27B-UD-Q6_K_XL" --tool "vLLM"The client prompts for context length and thinking mode, and for the KV cache dtype on Unsloth Studio. Sampling is left at the model default — the values above are what the tool reported using, not overrides the client sent.