Qwen3.8 27B
on 2× AMD Strix Halo 128GB · llama.cpp · 262,144 ctx
Use cases
codinglong-context
Summary
User reports 153.32 t/s at 32K context and 87.74 t/s at 200K context.
Setup uses a Q4 KV cache, speculative decoding with MTP and n-gram, and the vision encoder on the iGPU.
HumanEval scored 159/164 in 29.7 min.