llamaperf

Qwen3.8 27B

on AMD MI50 32GB · MI50-llama.cpp · 66,560 ctx

AMD hardware
Sep 25, 2026
Throughput
22.8 t/s gen
Quant
Q8_0 (GGUF)
KV cache
Q8_0
VRAM reported
32 GB

Use cases

codinglong-context

Summary

User reports Qwen3.8-27B at 22.8 tok/s decode on a single AMD Instinct MI50 32GB, using the MI50-llama.cpp fork. Setup is llama.cpp with Q8_0 weights and Q8_0 KV cache, flash attention on, one slot, 66560 context. Decode holds 22.0 tok/s at 16k and 20.4 tok/s at 64k; MTP with 3 drafts reaches 28.8 tok/s on a 64k reasoning prompt, 51.8 tok/s on short code, 43.2 tok/s on prose, and 24.2 tok/s on a 106.7k prompt. Max context is 114,688 with -ub 512. All figures are single-stream.