llamaperf

Qwen3.8 27B Swift-1.5

on AMD Radeon AI PRO R9700 32GB · WHIRL

Tone: positiveAMD hardware
Oct 3, 2026
Throughput
37.5 t/s gen
Quant
MXFP4 (GGUF)
VRAM reported
32 GB

Use cases

coding

Summary

User reports Qwen3.8-27B fine-tune Swift-1.5 at 37.5 t/s decode without speculation on a Radeon AI PRO R9700 32GB. Setup is WHIRL with MXFP4 GGUF weights, one GPU, Windows 11, Adrenalin 26.8.1. With MTP and n-gram speculation the same model reaches 107.5 t/s on Chinese coding prompts and 328 t/s on file-edit prompts; prefill is 3,278 t/s at 8k and 2,595 t/s at 32k. The server serves 199 t/s aggregate across 4 concurrent users. User notes the R9700 is connected as a USB4 eGPU, which slows model loading and cache restores but not prefill or decode. Plain decode on the dense models is only 1.1-1.18x faster than llama.cpp; most of the decode gap comes from MTP and n-gram speculation.