Qwen3.8 27B
on AMD MI50 32GB · MI50-llama.cpp · 66,560 ctx
Use cases
codinglong-context
Summary
User reports Qwen3.8-27B at 22.8 tok/s decode on a single AMD Instinct MI50 32GB, using the MI50-llama.cpp fork.
Setup is llama.cpp with Q8_0 weights and Q8_0 KV cache, flash attention on, one slot, 66560 context.
Decode holds 22.0 tok/s at 16k and 20.4 tok/s at 64k; MTP with 3 drafts reaches 28.8 tok/s on a 64k reasoning prompt, 51.8 tok/s on short code, 43.2 tok/s on prose, and 24.2 tok/s on a 106.7k prompt. Max context is 114,688 with -ub 512. All figures are single-stream.