Qwen3.8 27B
on CMP 50HX 20GB · llama.cpp
Summary
User reports Qwen3.8 27B running at around 7-10 t/s on a CMP 50HX upgraded to 20GB VRAM.
Setup is llama.cpp b10434 with UD-Q4_K_XL and Q4_K_M quants; the user says context size, KV-cache quantization and MTP on/off made no difference.
The user compares this with Qwen 3.6 27B Q4_K_M with MTP enabled, which gives around 25 t/s on the same hardware.