Fastest
qwen3.8-9b-distill
9B
119.5 tok/s
Highest token generation speed at 119.5 tok/s.
Hardware Benchmarks
Compare 2× A10g benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for 2× A10g.
Fastest
9B
Highest token generation speed at 119.5 tok/s.
Best quality
27B
Highest completed quality score at 85.0.
Which models actually run best on the 2× A10g, by task, from community benchmark data.
Completed quality-ranked benchmark results for 2× NVIDIA A10G.