Qwen3.8 27B
on AMD Strix Halo 128GB · llama.cpp · 262,144 ctx
Use cases
codingagentic
Summary
User reports running the pi coding agent with llama.cpp on Strix Halo, decoding at 26+ t/s and prefilling at ~200 t/s in the fast band.
Setup uses Qwen3.8-27B with the UD-Q4_K_XL quant, a DFlash2 drafter, f16 KV cache and 256k context. A Flash-Next model with IQ4_XS quant and MTP is also mentioned.
The KV cache hit rate is ~94%.