Model benchmarks

Qwen3.6-27B-UD-MLX-4bit local LLM performance

As of July 2026, Qwen3.6-27B-UD-MLX-4bit runs at up to 15.0 tok/s for local inference (best of 5 community benchmark runs across 1 GPU).

oMLX

Model size

27B

Peak speed

15.0 tok/s

Average speed

11.8 tok/s

Min memory

n/a

Max context

12,311 tokens

Best quality

91.9

Benchmark runs

5

GPUs tested

1

Performance by hardware and tool

Every hardware/tool/quantization combination Qwen3.6-27B-UD-MLX-4bit has been benchmarked on, ranked by peak token generation speed. Last updated July 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
Apple M5 MaxoMLX15.0 tok/s11.8 tok/sn/a12,311 tokens73.45

Frequently asked questions

How fast is Qwen3.6-27B-UD-MLX-4bit for local inference?
Across 5 community benchmark runs, Qwen3.6-27B-UD-MLX-4bit reaches up to 15.0 tok/s and averages 11.8 tok/s, with the fastest results on Apple M5 Max.
How much memory does Qwen3.6-27B-UD-MLX-4bit need?
The leanest observed configuration used about n/a of memory.
Which tools have been used to run Qwen3.6-27B-UD-MLX-4bit?
Benchmarks were submitted using oMLX. Results are community-contributed and updated as new runs arrive.