Qwen3.8 27B
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.8 27B at 6.7 t/s generation and 312 t/s prompt processing on an AMD Strix Halo 128GB box with a Radeon 8060S.
Setup is llama.cpp on the rdna35-perf ROCm/HIP branch with Q8_0 weights, q8_0 KV cache, Flash Attention on and microbatch 2048, measured with llama-bench.
Both figures are separate benchmark cells at 128k tokens already in the KV cache, not one end-to-end request; the prompt test processes 2048 additional tokens at that depth.