Qwen3.8 27B
on AMD RX 7900 XTX · llama.cpp · 106,496 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-27B at 78.53 t/s generation and 523.33 t/s prompt processing on a Radeon RX 7900 XTX 24GB.
Setup is llama.cpp 2.61.0 (Vulkan backend, LM Studio) with Q4_K_M GGUF and q8_0 KV cache at 106496 context, whole model on the single GPU (16.8GB of 24GB VRAM). Speculative decoding was on (MTP + ngram, spec-draft-n-max 2), so the generation figure is an effective speed with draft acceptance of 78/98.
Four runs, one request at a time: generation ranged 61.68 to 78.53 t/s across runs. Runs 3 and 4 repeated a cached prompt (588 of 592 tokens), so their prompt speeds are startup time, not prefill. The user runs this model as a daily driver for coding and agent work.