Qwen3.8 27B
on AMD RX 7900 XTX · llama.cpp · 262,144 ctx
Oct 1, 2026
Summary
User reports Qwen3.8-27B at 68.9 t/s on an RX 7900 XTX 24 GB at empty context with MTP n=3 speculative decoding, and 37.2 t/s without MTP.
Setup is llama.cpp (ROCm, hip-kvmix) with IQ3_S GGUF and q8_0/q5_1 KV cache at 262,144-token context.
At 240K fill with MTP the user reports 18.6-26.9 t/s (mean 23.3) and 380 t/s prefill, with 22,630 MiB peak VRAM.