llamaperf

Qwen3.8 27B ASCII-Condensed

on AMD RX 9070 · llama.cpp · 262,144 ctx

Tone: mixedAMD hardware
Oct 25, 2026
Throughput
81.0 t/s gen
Quant
UD-IQ4_XS (GGUF)
KV cache
q8_0/q4_0
System RAM
32 GB
VRAM reported
16 GB

Use cases

codinglong-context

Summary

User reports Qwen3.8-27B ASCII-Condensed UD-IQ4_XS at about 81 t/s code generation on an RX 9070 16 GB card with 32 GB system RAM, running on Windows. Setup is achyudh's llama.cpp ROCm KV-streaming fork with q8_0 K / q4_0 V cache, 262144 context, --kv-stream with 300/1800 MiB resident KV, MTP n=4 plus n-gram speculation, and 6 threads. Decode was 75 t/s at 9k and 95 t/s at 21k tokens, prefill about 1000+ t/s; these are single runs on short prompts, not filled 64k-262k contexts, and output quality was not checked. The user notes their numbers are below the fork README's ~100+ t/s at 16k-64k.