Model benchmarks

Tiel-Coder-35B-A3B-MLX-oQ4e local LLM performance

As of August 2026, Tiel-Coder-35B-A3B-MLX-oQ4e runs at up to 121.4 tok/s for local inference (best of 5 community benchmark runs across 1 GPU).

oMLX
ShareRedditX

Model size

35B

Peak speed

121.4 tok/s

Average speed

107.9 tok/s

Min memory

21.2 GB

Max context

262,144 tokens

Avg runtime / run

5m 10s

Avg quality

83.6

Benchmark runs

5

GPUs tested

1

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 5 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall79.783.685.7
Agent Workflow75.583.488.0
Code Generation77.281.585.6
Role Play & Narrative82.785.589.1
Research & Analysis81.684.287.5

Performance by hardware and tool

Every hardware/tool/quantization combination Tiel-Coder-35B-A3B-MLX-oQ4e has been benchmarked on, ranked by peak token generation speed. Last updated August 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
Apple M5 MaxoMLX—121.4 tok/s107.9 tok/s21.2 GB262,144 tokens83.65

Benchmark runs

All 5 Tiel-Coder-35B-A3B-MLX-oQ4e runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

Is Tiel-Coder-35B-A3B-MLX-oQ4e good for agentic (tool-using) tasks?
In our benchmarks, Tiel-Coder-35B-A3B-MLX-oQ4e scores 83.4/100 for agentic workflows. It runs at about 107.9 tok/s, so if you want more speed, Nex-N2.5-mini-MLX-4bit is faster (~137.0 tok/s) and still scores well for agentic workflows (81.2/100).
How fast is Tiel-Coder-35B-A3B-MLX-oQ4e for local inference?
Across 5 community benchmark runs, Tiel-Coder-35B-A3B-MLX-oQ4e reaches up to 121.4 tok/s and averages 107.9 tok/s, with the fastest results on Apple M5 Max.
How much memory does Tiel-Coder-35B-A3B-MLX-oQ4e need?
The leanest observed configuration used about 21.2 GB of memory.
Which tools have been used to run Tiel-Coder-35B-A3B-MLX-oQ4e?
Benchmarks were submitted using oMLX. Results are community-contributed and updated as new runs arrive.