Model benchmarks

ornith-1.5-9b local LLM performance

As of August 2026, ornith-1.5-9b runs at up to 94.0 tok/s for local inference (best of 4 community benchmark runs across 2 GPUs).

LM Studio
ShareRedditX

Model size

9B

Peak speed

94.0 tok/s

Average speed

77.3 tok/s

Min memory

4.4 GB

Max context

10,070 tokens

Best quality

90.5

Benchmark runs

4

GPUs tested

2

Performance by hardware and tool

Every hardware/tool/quantization combination ornith-1.5-9b has been benchmarked on, ranked by peak token generation speed. Last updated August 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
NVIDIA GeForce RTX 3080LM Studio94.0 tok/s93.8 tok/s4.4 GB6,859 tokens54.33
AMD Radeon RX 7600 XTLM Studio27.6 tok/s27.6 tok/s9.7 GB10,070 tokens82.61

Frequently asked questions

How fast is ornith-1.5-9b for local inference?
Across 4 community benchmark runs, ornith-1.5-9b reaches up to 94.0 tok/s and averages 77.3 tok/s, with the fastest results on NVIDIA GeForce RTX 3080.
How much memory does ornith-1.5-9b need?
The leanest observed configuration used about 4.4 GB of memory.
Which tools have been used to run ornith-1.5-9b?
Benchmarks were submitted using LM Studio. Results are community-contributed and updated as new runs arrive.