llamaperf

Qwen3.6 27B

on NVIDIA CMP 170HX 64GB (unlocked) · llama.cpp

NVIDIA hardware
Oct 14, 2026
Throughput
38.0 t/s gen · 907.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
VRAM reported
64 GB

Summary

LTT Labs original tests, September 12, 2026. Selected run: one unlocked NVIDIA CMP 170HX, 64GB GPU memory, Qwen 3.6 27B Q4_K_M GGUF. Prefill pp512: 907 tokens/s; pp8192: 888 tokens/s; generation tg128: 38 tokens/s. Command: ./llama-bench -m <model> -fa 1 -ngl 999 -r 5 -d 0 -n 128 -p 512,8192. All tests have zero context depth; five repetitions, flash attention and full GPU layer request. CPU, system RAM, runtime commit, CUDA version, actual resident memory and tested artifact revision are unknown. Approximately 16GB is model file size, not resident RAM. Exact tested quantization repository linked by author: https://huggingface.co/bartowski/Qwen_Qwen3.6-27B-GGUF . Source: https://www.lttlabs.com/articles/2026/09/12/cmp-170hx-cmpunlocker . Other models and multi-card comparisons in the source are separate runs.