Model benchmarks

Qwen3.8-Flash-Next UD-IQ1_S local LLM performance

As of November 2026, Qwen3.8-Flash-Next UD-IQ1_S runs at up to 365.8 tok/s for local inference (best of 2 community benchmark runs across 1 GPU).

llama.cpp
ShareRedditX

Model size

Unknown

Peak speed

365.8 tok/s

Average speed

343.5 tok/s

Avg PP

2046.4 tok/s

Min memory

55.2 GB

Max context

262,144 tokens

Avg output / run

56,875 tokens

Avg runtime / run

2m 35s

Avg quality

75.5

Benchmark runs

2

GPUs tested

1

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 2 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall65.375.585.7
Agent Workflow4.645.586.5
Code Generation76.077.879.6
Role Play & Narrative89.190.491.7
Research & Analysis88.188.488.7

Performance by hardware and tool

Every hardware/tool/quantization combination Qwen3.8-Flash-Next UD-IQ1_S has been benchmarked on, ranked by peak token generation speed. Last updated November 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
NVIDIA GeForce RTX 5090llama.cpp—365.8 tok/s343.5 tok/s55.2 GB262,144 tokens75.52

Benchmark runs

All 2 Qwen3.8-Flash-Next UD-IQ1_S runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

How fast is Qwen3.8-Flash-Next UD-IQ1_S for local inference?
Across 2 community benchmark runs, Qwen3.8-Flash-Next UD-IQ1_S reaches up to 365.8 tok/s and averages 343.5 tok/s, with the fastest results on NVIDIA GeForce RTX 5090.
How much memory does Qwen3.8-Flash-Next UD-IQ1_S need?
The leanest observed configuration used about 55.2 GB of memory.
Which tools have been used to run Qwen3.8-Flash-Next UD-IQ1_S?
Benchmarks were submitted using llama.cpp. Results are community-contributed and updated as new runs arrive.