Qwen3.8 27B
on 2× CMP 50HX · llama.cpp · 130,000 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at around 30-35 t/s on two CMP 50HX mining cards (20GB + 10GB, 30GB total) with MTP enabled.
Setup is llama.cpp with a Q6_K GGUF at 130k context and K Q8_0 / V Q5_1 KV cache, GPUs capped at 180W. Prompt processing is around 300-400 t/s.
A 256k context preset with Q8_0 KV cache runs at 10-14 t/s with prompt processing around 40-50 t/s. Ornith 1.5 35B-A3B (Heretic-MTP-APEX-I-Balanced) reaches 80-100 t/s. A Q4_K_M Unsloth quant with 1,1 tensor split and MTP gives around 40 t/s.