Benchmark result

Tiel-Coder-35B-A3B-MLX-oQ4e on Apple M5 Max — 65.9 tok/s

Measured with oMLX 0.31.3 on August 24, 2026.

ShareRedditX

LLM / Model

Model Size
35B
Memory Kind
model
Tool
oMLX v0.31.3
Scenarios

LLM Quality Assessment

Agent WorkflowopenclawCOMPLETED
Overall Quality Score
85.90
coherence
92
decomposition
90
error_handling
84
tool_selection
78

Strong, logically ordered 4-step plan with clear dependencies and a sensible final synthesis step. It uses web search appropriately for benchmark citations and execute_code for consolidation, while correctly identifying send_email as unnecessary. Minor weaknesses: it introduces extra details beyond the strict plan format, and the claim that search_web alone can reliably obtain all needed metrics may be optimistic, especially for specialized domain models and exact inference speed data.

Code Generationcoding_agentCOMPLETED▶ Play Game
Overall Quality Score
85.00
correctness
86
performance
88
code_quality
82
completeness
84

The game is largely functional and close to the requested Breakout implementation, with good mobile support, scoring, lives, win/lose states, and canvas-only rendering. Main weaknesses are collision precision and some edge-case handling, especially around strict AABB requirements and discrete-step tunneling/multi-hit behavior.

Role Play & NarrativeroleplayCOMPLETED
Overall Quality Score
84.95
dialogue
91
immersion
93
consistency
95
narrative_arc
38

Excellent character voice and atmosphere, with a convincing reaction to Kestra, but it is incomplete as a full roleplay response because it stops before the required arc develops.

Research & AnalysisresearchCOMPLETED
Overall Quality Score
83.30
depth
88
clarity
90
insight
84
interpretation
74

Strong, well-structured analysis with good comparative insights and clear recommendations. However, the interpretation is weakened by confounding architecture differences, somewhat imprecise scaling classification, and limited statistical grounding for the extrapolation.

GPU Acceleration

GPU Model
Apple M5 Max
VRAM
128 GB

Performance Metrics

Generation Speed
65.9
tokens/sec
TTFT
614
milliseconds
Memory Usage
23.97
GB
Memory (Raw)
24546
MB

Context Information

Tokens Used
15177
Context Window
262,144

CPU & Memory

CPU Model
Apple M5 Max
CPU Threads
18
Physical Cores
18
CPU Frequency
N/A
Total RAM
128 GB

Operating System

OS Name
macos
OS Version
26.5.1
Kernel Version
25.5.0

Submission Details

Submitted:
8/24/2026, 6:32:02 PM
Client:
v0.4.43+97
Benchmark Result ID:
cmt7kp2zj002r01lcmpchvlko