llamaperf

Qwen3.8 27B

on AMD RX 7900 XT · llama.cpp · 65,536 ctx

Tone: mixedAMD hardware
Oct 3, 2026
Throughput
52.0 t/s gen · 708.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
q8_0
System RAM
32 GB
VRAM reported
20 GB

Use cases

codingagentic

Summary

User benchmarks a local Qwen3.8-27B at 52.0 tok/s decode and 708 tok/s prefill on an RX 7900 XT, used as a coding executor for Claude across 51 runs. Setup is llama.cpp llama-server with IQ4_XS at 64K context, q8_0 KV cache, flash attention, full GPU offload, and MTP speculative decoding (draft n_max 2, p_min 0.75). The 27B was correct after review on 43/51 runs versus Sonnet 5's 45/51, tied on full-code and debug tasks, and failed all interface-only lifecycle and in-memory repository tasks. End-to-end throughput in the agent was 47.4 tok/s for the 27B and 107.8 tok/s for Sonnet, which cost $9.20 in API usage.