Hardware Benchmarks

Best Local LLM Performance for 4× Tesla T4

Compare 4× Tesla T4 benchmark results and see which models actually earn the best completed quality scores.

ShareRedditX

Hardware Overview

GPU-specific specifications for local LLM planning.

4× Tesla T4
VRAM
60GB
Architecture
Multi-GPU

Recommended Models

Models we recommend for 4× Tesla T4.

Fastest & Best quality & Largest context tested

qwen3.8-flash-next-unsloth-ud-q4_k_xl

Unknown

23.0 tok/sQuality 82.0Context 262,144 tokens

Highest token generation speed at 23.0 tok/s. Highest completed quality score at 82.0. Largest context window tested on this hardware, at 262,144 tokens.

Frequently asked questions

Which models actually run best on the 4× Tesla T4, by task, from community benchmark data.

What is the best local model for coding on the 4× Tesla T4?
On the 4× Tesla T4, qwen3.8-flash-next-unsloth-ud-q4_k_xl ranks first for coding in our benchmarks (51.1/100 at ~21.8 tok/s).
What is the best local model for agentic workflows on the 4× Tesla T4?
On the 4× Tesla T4, qwen3.8-flash-next-unsloth-ud-q4_k_xl ranks first for agentic workflows in our benchmarks (91.6/100 at ~21.8 tok/s).

Benchmark Results

Completed quality-ranked benchmark results for 4× Tesla T4.

Open run page →
Open run page →