Qwen3.8 27B
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.8-27B FP4 at 14.0 t/s bare decode on an AMD Strix Halo (Radeon 8060S), with prefill at 440 t/s on pp512.
Setup is a llama.cpp fork with a Vulkan backend on stock Mesa RADV 26.0.8, greedy, 300 tokens, with no speculative decoding.
With an FP4 DFlash2 sidecar and adaptive drafting (n_min 3, n_max 7) the same model reaches 65.6 t/s on structured output and 26.1 on prose, on a short high-power burst (79 °C, 115 W). On the everyday power profile that configuration reads 55.0 t/s on structured output.