llamaperf

Qwen3.6 35B (3B active)

on 12× NVIDIA V100 32GB · llama.cpp

Tone: mixedNVIDIA hardware
Aug 28, 2026
Throughput
82.0 t/s gen
Quant
Q8 (GGUF)
KV cache
Q4
VRAM reported
32 GB

Use cases

coding

Summary

User reports Qwen3.5-122B-A10B at 50 t/s and Gemma-4-26B-A4B at 113 t/s on a system with 16 GPUs. The system runs multiple models across the 16 GPUs. User notes hallucinations and pipeline issues.