Qwen3.6 27B
on NVIDIA CMP 170HX 64GB (unlocked) · llama.cpp
Oct 14, 2026
Summary
LTT Labs original tests, September 12, 2026. Selected run: one unlocked NVIDIA CMP 170HX, 64GB GPU memory, Qwen 3.6 27B Q4_K_M GGUF. Prefill pp512: 907 tokens/s; pp8192: 888 tokens/s; generation tg128: 38 tokens/s. Command: ./llama-bench -m <model> -fa 1 -ngl 999 -r 5 -d 0 -n 128 -p 512,8192. All tests have zero context depth; five repetitions, flash attention and full GPU layer request. CPU, system RAM, runtime commit, CUDA version, actual resident memory and tested artifact revision are unknown. Approximately 16GB is model file size, not resident RAM. Exact tested quantization repository linked by author: https://huggingface.co/bartowski/Qwen_Qwen3.6-27B-GGUF . Source: https://www.lttlabs.com/articles/2026/09/12/cmp-170hx-cmpunlocker . Other models and multi-card comparisons in the source are separate runs.