Qwen3.6 27B
NVIDIA CMP 170HX 64GB (unlocked) · llama.cpp
- generation:
- 38.0 tokens/s
- prompt processing (prefill):
- 907.0 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Qwen3.6 27B at 38 t/s generation on an unlocked NVIDIA CMP 170HX 64GB. Setup is llama.cpp with Q4_K_M and flash attention, full GPU layer offload, zero context depth. Prompt processing measured 907 t/s at pp512 and 888 t/s at pp8192, five repetitions each; the model file is about 16GB.