llamaperf

Qwen3.8 27B CODER

on AMD RX 7900 XTX · llama.cpp · 262,144 ctx

Tone: positiveAMD hardware
Oct 2, 2026
Throughput
36-41 t/s gen · 175-183 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
q4_1
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B CODER decoding at 36-41 t/s on an RX 7900 XTX with 110k-170k tokens already in context. Setup is llama.cpp b11235 on the Vulkan backend with an IQ4_XS imatrix GGUF, q4_1 KV cache, 262144-token context, all layers on the GPU, and MTP speculative decoding from the file's own Q8_0 draft head. Across 98 agentic coding requests the median decode was 41.2 t/s (33.8-46.0) at 65k-131k context and 36.0 t/s (30.7-43.0) at 131k-171k. MTP draft acceptance median 85% (75-94%), about 2.7 tokens per decode step at draft depth 2. Prefill 387 t/s for a cold 108k-token prompt and 175-183 t/s for about 4.5k new tokens at 147k-156k depth. VRAM use 24.2 of 24.6 GB at 245,760 tokens of context, with the vision projector on the CPU.