Model benchmarks

qwen3.8-flash-next-iq2_xs local LLM performance

As of November 2026, qwen3.8-flash-next-iq2_xs runs at up to 114.6 tok/s for local inference (best of 14 community benchmark runs across 5 GPUs).

Strata
ShareRedditX

Model size

Unknown

Peak speed

114.6 tok/s

Average speed

73.4 tok/s

Avg PP

270.3 tok/s

Min memory

3.4 GB

Max context

262,144 tokens

Avg output / run

45,120 tokens

Avg runtime / run

15m 7s

Avg quality

79.0

Benchmark runs

14

GPUs tested

5

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 14 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall58.179.086.7
Agent Workflow20.075.989.8
Code Generation0.065.885.4
Role Play & Narrative85.689.492.6
Research & Analysis81.084.889.1

Performance by hardware and tool

Every hardware/tool/quantization combination qwen3.8-flash-next-iq2_xs has been benchmarked on, ranked by peak token generation speed. Last updated November 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
NVIDIA GeForce RTX 3090Strata—114.6 tok/s114.6 tok/sn/a65,536 tokens47.71
NVIDIA GeForce RTX 4070 SUPERStrata—80.4 tok/s80.4 tok/sn/a65,536 tokens64.91
AMD Radeon RX 9070/9070 XT/9070 GREStrata—78.2 tok/s69.7 tok/s3.4 GB262,144 tokens85.75
AMD Radeon RX 7900 XTStrata—77.4 tok/s73.4 tok/s42.3 GB65,536 tokens83.56
Advanced Micro Devices, Inc. [AMD/ATI] Device 7551Strata—44.3 tok/s44.3 tok/sn/a131,972 tokens63.71

Benchmark runs

All 14 qwen3.8-flash-next-iq2_xs runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

Is qwen3.8-flash-next-iq2_xs good for coding?
In our benchmarks, qwen3.8-flash-next-iq2_xs scores 65.8/100 for coding. It runs at about 73.4 tok/s, so if you want more speed, qwen3.8-27b-Swift1.5-Uncensored-ATX-AI3 is faster (~85.5 tok/s) and still scores well for coding (84.8/100).
Is qwen3.8-flash-next-iq2_xs good for agentic (tool-using) tasks?
In our benchmarks, qwen3.8-flash-next-iq2_xs scores 75.9/100 for agentic workflows. It runs at about 73.4 tok/s, so if you want more speed, Nex-N2.5-mini-APEX-Mini is faster (~88.2 tok/s) and still scores well for agentic workflows (91.3/100).
How fast is qwen3.8-flash-next-iq2_xs for local inference?
Across 14 community benchmark runs, qwen3.8-flash-next-iq2_xs reaches up to 114.6 tok/s and averages 73.4 tok/s, with the fastest results on NVIDIA GeForce RTX 3090.
How much memory does qwen3.8-flash-next-iq2_xs need?
The leanest observed configuration used about 3.4 GB of memory.
Which tools have been used to run qwen3.8-flash-next-iq2_xs?
Benchmarks were submitted using Strata. Results are community-contributed and updated as new runs arrive.