Model benchmarks

gemma4:12b-mlx local LLM performance

As of November 2026, gemma4:12b-mlx runs at up to 68.5 tok/s for local inference (best of 3 community benchmark runs across 3 GPUs).

Ollamanvfp4
ShareRedditX

Model size

12.4B

Peak speed

68.5 tok/s

Average speed

47.7 tok/s

Avg PP

179.3 tok/s

Min memory

9.3 GB

Max context

131,072 tokens

Avg output / run

11,815 tokens

Avg runtime / run

4m 41s

Avg quality

67.6

Benchmark runs

3

GPUs tested

3

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 3 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall59.867.672.8
Agent Workflow69.275.980.4
Code Generation43.155.262.9
Role Play & Narrative65.970.575.3
Research & Analysis61.068.773.8

Performance by hardware and tool

Every hardware/tool/quantization combination gemma4:12b-mlx has been benchmarked on, ranked by peak token generation speed. Last updated November 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
Apple M5 MaxOllamanvfp468.5 tok/s68.5 tok/s9.3 GB131,072 tokens58.61
Apple M4 ProOllamanvfp447.1 tok/s47.1 tok/s9.3 GB131,072 tokens73.01
Apple M1 MaxOllamanvfp427.5 tok/s27.5 tok/s13.0 GB32,768 tokens71.21

Benchmark runs

All 3 gemma4:12b-mlx runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

Is gemma4:12b-mlx good for coding?
In our benchmarks, gemma4:12b-mlx scores 55.2/100 for coding. It runs at about 47.7 tok/s, so if you want more speed, qwen3.8-27b-Swift1.5-Uncensored-ATX-AI3 is faster (~85.5 tok/s) and still scores well for coding (84.8/100).
Is gemma4:12b-mlx good for agentic (tool-using) tasks?
In our benchmarks, gemma4:12b-mlx scores 75.9/100 for agentic workflows. It runs at about 47.7 tok/s, so if you want more speed, Nex-N2.5-mini-APEX-Mini is faster (~88.2 tok/s) and still scores well for agentic workflows (91.3/100).
How fast is gemma4:12b-mlx for local inference?
Across 3 community benchmark runs, gemma4:12b-mlx reaches up to 68.5 tok/s and averages 47.7 tok/s, with the fastest results on Apple M5 Max.
How much memory does gemma4:12b-mlx need?
The leanest observed configuration used about 9.3 GB of memory (quantizations tested: nvfp4).
Which tools have been used to run gemma4:12b-mlx?
Benchmarks were submitted using Ollama. Results are community-contributed and updated as new runs arrive.