Fastest
sage
Unknown
87.2 tok/s
Highest token generation speed at 87.2 tok/s.
Hardware Benchmarks
Compare 2× Tesla V100 Pcie 32gb benchmark results and see which models actually earn the best completed quality scores.
GPU-specific specifications for local LLM planning.
Models we recommend for 2× Tesla V100 Pcie 32gb.
Fastest
Unknown
Highest token generation speed at 87.2 tok/s.
Best quality & Largest context
27B
Highest completed quality score at 86.2. Largest context that fits in 64GB VRAM, at 32,768 tokens.
Which models actually run best on the 2× Tesla V100 Pcie 32gb, by task, from community benchmark data.
Completed quality-ranked benchmark results for 2× Tesla V100-PCIE-32GB.