llamaperf

Qwen3.8 27B

on 2× CMP 50HX · llama.cpp · 130,000 ctx

Tone: positive
Sep 19, 2026
Throughput
30-35 t/s gen · 350.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q6_K (GGUF)
KV cache
K: Q8_0, V: Q5_1
MTP (Multi-Token Prediction)
on
System RAM
32 GB
VRAM reported
30 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at around 30-35 t/s on two CMP 50HX mining cards (20GB + 10GB, 30GB total) with MTP enabled. Setup is llama.cpp with a Q6_K GGUF at 130k context and K Q8_0 / V Q5_1 KV cache, GPUs capped at 180W. Prompt processing is around 300-400 t/s. A 256k context preset with Q8_0 KV cache runs at 10-14 t/s with prompt processing around 40-50 t/s. Ornith 1.5 35B-A3B (Heretic-MTP-APEX-I-Balanced) reaches 80-100 t/s. A Q4_K_M Unsloth quant with 1,1 tensor split and MTP gives around 40 t/s.