Qwen3.6 27B
on NVIDIA V100 32GB · llama.cpp
Sep 29, 2026
Summary
User reports Qwen3.6 27B at 32.17 t/s generation on a single NVIDIA Tesla V100 SXM2 32GB.
Setup is llama.cpp (build 6eab47181) with Q4_K_M GGUF weights, run via llama-bench with -p 0 and -n 128,256,512,1024,2048, steady across those generation lengths.
Other quants measured on the same card: Q5_K_M 29.14 t/s, Q6_K 25.11 t/s, Q8_0 22.80 t/s. BF16 required an added RTX 3090 24GB and ran 15.27 t/s.