Qwen3.8 27B
on AMD RX 7900 XT · llama.cpp · 65,536 ctx
Use cases
codingagentic
Summary
User benchmarks a local Qwen3.8-27B at 52.0 tok/s decode and 708 tok/s prefill on an RX 7900 XT, used as a coding executor for Claude across 51 runs.
Setup is llama.cpp llama-server with IQ4_XS at 64K context, q8_0 KV cache, flash attention, full GPU offload, and MTP speculative decoding (draft n_max 2, p_min 0.75).
The 27B was correct after review on 43/51 runs versus Sonnet 5's 45/51, tied on full-code and debug tasks, and failed all interface-only lifecycle and in-memory repository tasks. End-to-end throughput in the agent was 47.4 tok/s for the 27B and 107.8 tok/s for Sonnet, which cost $9.20 in API usage.