Use cases
coding
Summary
User reports Qwen3.8-27B fine-tune Swift-1.5 at 37.5 t/s decode without speculation on a Radeon AI PRO R9700 32GB.
Setup is WHIRL with MXFP4 GGUF weights, one GPU, Windows 11, Adrenalin 26.8.1. With MTP and n-gram speculation the same model reaches 107.5 t/s on Chinese coding prompts and 328 t/s on file-edit prompts; prefill is 3,278 t/s at 8k and 2,595 t/s at 32k. The server serves 199 t/s aggregate across 4 concurrent users.
User notes the R9700 is connected as a USB4 eGPU, which slows model loading and cache restores but not prefill or decode. Plain decode on the dense models is only 1.1-1.18x faster than llama.cpp; most of the decode gap comes from MTP and n-gram speculation.