llamaperf

Qwen3.8 27B Swift-1.5

on AMD RX 7900 XT · llama.cpp

Tone: mixedAMD hardware
Oct 28, 2026
Throughput
60-70 t/s gen
Quant
IQ3_S (GGUF)
KV cache
q8_0
System RAM
32 GB
VRAM reported
20 GB

Summary

User reports Qwen3.8-27B (Swift-1.5 fine-tune, IQ3_S GGUF) at 60-70 t/s in short conversations on an RX 7900 XT 20GB, dropping to 45-50 t/s with around 90k words of history. Setup is llama.cpp (RDNA-boosts build) with q8_0 K and V cache, MTP plus n-gram speculation at n-max 2, auto-fit context with a 512MB margin, and all layers on the card. An earlier config that spilled into system RAM ran 27-28 t/s. Compressing the MTP head's memory saved about 1GB but dropped acceptance from about 0.7 to about 0.5 and cut speed; compressing the KV cache to q4 made no speed difference. An external DFlash2 draft model measured about the same as the built-in guesser.