Model benchmarks
qwen3.8-flash-next-iq2_xs local LLM performance
As of November 2026, qwen3.8-flash-next-iq2_xs runs at up to 114.6 tok/s for local inference (best of 14 community benchmark runs across 5 GPUs).
Model size
Unknown
Peak speed
114.6 tok/s
Average speed
73.4 tok/s
Avg PP
270.3 tok/s
Min memory
3.4 GB
Max context
262,144 tokens
Avg output / run
45,120 tokens
Avg runtime / run
15m 7s
Avg quality
79.0
Benchmark runs
14
GPUs tested
5
Quality by task
Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 14 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.
| Task | P5 (low) | Avg | P95 (high) |
|---|---|---|---|
| Overall | 58.1 | 79.0 | 86.7 |
| Agent Workflow | 20.0 | 75.9 | 89.8 |
| Code Generation | 0.0 | 65.8 | 85.4 |
| Role Play & Narrative | 85.6 | 89.4 | 92.6 |
| Research & Analysis | 81.0 | 84.8 | 89.1 |
Performance by hardware and tool
Every hardware/tool/quantization combination qwen3.8-flash-next-iq2_xs has been benchmarked on, ranked by peak token generation speed. Last updated November 2026.
| Hardware | Tool | Quant | Best tok/s | Avg tok/s | Memory | Context | Quality | Runs |
|---|---|---|---|---|---|---|---|---|
| NVIDIA GeForce RTX 3090 | Strata | — | 114.6 tok/s | 114.6 tok/s | n/a | 65,536 tokens | 47.7 | 1 |
| NVIDIA GeForce RTX 4070 SUPER | Strata | — | 80.4 tok/s | 80.4 tok/s | n/a | 65,536 tokens | 64.9 | 1 |
| AMD Radeon RX 9070/9070 XT/9070 GRE | Strata | — | 78.2 tok/s | 69.7 tok/s | 3.4 GB | 262,144 tokens | 85.7 | 5 |
| AMD Radeon RX 7900 XT | Strata | — | 77.4 tok/s | 73.4 tok/s | 42.3 GB | 65,536 tokens | 83.5 | 6 |
| Advanced Micro Devices, Inc. [AMD/ATI] Device 7551 | Strata | — | 44.3 tok/s | 44.3 tok/s | n/a | 131,972 tokens | 63.7 | 1 |
Benchmark runs
All 14 qwen3.8-flash-next-iq2_xs runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.
Frequently asked questions
- Is qwen3.8-flash-next-iq2_xs good for coding?
- In our benchmarks, qwen3.8-flash-next-iq2_xs scores 65.8/100 for coding. It runs at about 73.4 tok/s, so if you want more speed, qwen3.8-27b-Swift1.5-Uncensored-ATX-AI3 is faster (~85.5 tok/s) and still scores well for coding (84.8/100).
- Is qwen3.8-flash-next-iq2_xs good for agentic (tool-using) tasks?
- In our benchmarks, qwen3.8-flash-next-iq2_xs scores 75.9/100 for agentic workflows. It runs at about 73.4 tok/s, so if you want more speed, Nex-N2.5-mini-APEX-Mini is faster (~88.2 tok/s) and still scores well for agentic workflows (91.3/100).
- How fast is qwen3.8-flash-next-iq2_xs for local inference?
- Across 14 community benchmark runs, qwen3.8-flash-next-iq2_xs reaches up to 114.6 tok/s and averages 73.4 tok/s, with the fastest results on NVIDIA GeForce RTX 3090.
- How much memory does qwen3.8-flash-next-iq2_xs need?
- The leanest observed configuration used about 3.4 GB of memory.
- Which tools have been used to run qwen3.8-flash-next-iq2_xs?
- Benchmarks were submitted using Strata. Results are community-contributed and updated as new runs arrive.