Unknown family
on 2× NVIDIA V100 32GB · llama.cpp
Sep 7, 2026
Summary
User reports about 20 t/s generation with a Q8 quant on 2x V100 32GB GPUs, 64 GB of VRAM in total, using llama.cpp.
The model family is not specified.
User asks about running multiple concurrent instances or agents in parallel to raise aggregate throughput.