Fastest
gemma4:latest
7.5B
109.9 tok/s
Highest token generation speed at 109.9 tok/s.
Hardware Benchmarks
Compare RTX 4060 benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for RTX 4060.
Fastest
7.5B
Highest token generation speed at 109.9 tok/s.
Best quality
20.9B
Highest completed quality score at 76.5.
Largest context tested
9.0B
Largest context window tested on this hardware, at 131,072 tokens.
Which models actually run best on the RTX 4060, by task, from community benchmark data.
Completed quality-ranked benchmark results for NVIDIA GeForce RTX 4060.