Fastest
qwen3.5:4b-q4_K_M
4.2B
36.1 tok/s
Highest token generation speed at 36.1 tok/s.
Hardware Benchmarks
Compare Apple M3 Pro benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for Apple M3 Pro.
Fastest
4.2B
Highest token generation speed at 36.1 tok/s.
Best quality & Largest context
9.0B
Highest completed quality score at 70.9. Largest context that fits in 36GB VRAM, at 65,536 tokens.
Which models actually run best on the Apple M3 Pro, by task, from community benchmark data.
Completed quality-ranked benchmark results for Apple M3 Pro.