Model benchmarks
qwen/qwen3.5-35b-a3b local LLM performance
As of April 2026, qwen/qwen3.5-35b-a3b runs at up to 34.2 tok/s for local inference (best of 8 community benchmark runs across 1 GPU).
LM Studio
Model size
35B
Peak speed
34.2 tok/s
Average speed
29.1 tok/s
Min memory
n/a
Max context
16,384 tokens
Best quality
92.4
Benchmark runs
8
GPUs tested
1
Performance by hardware and tool
Every hardware/tool/quantization combination qwen/qwen3.5-35b-a3b has been benchmarked on, ranked by peak token generation speed. Last updated April 2026.
| Hardware | Tool | Quant | Best tok/s | Avg tok/s | Memory | Context | Quality | Runs |
|---|---|---|---|---|---|---|---|---|
| AMD Radeon RX 7900 XTX | LM Studio | — | 34.2 tok/s | 29.1 tok/s | n/a | 16,384 tokens | 65.9 | 8 |
Frequently asked questions
- How fast is qwen/qwen3.5-35b-a3b for local inference?
- Across 8 community benchmark runs, qwen/qwen3.5-35b-a3b reaches up to 34.2 tok/s and averages 29.1 tok/s, with the fastest results on AMD Radeon RX 7900 XTX.
- How much memory does qwen/qwen3.5-35b-a3b need?
- The leanest observed configuration used about n/a of memory.
- Which tools have been used to run qwen/qwen3.5-35b-a3b?
- Benchmarks were submitted using LM Studio. Results are community-contributed and updated as new runs arrive.