Qwen3.8 27B Swift-1.5
on AMD RX 7900 XT · hipfire · 16,384 ctx
Summary
User reports the Swift-1.5 fine-tune of Qwen3.8-27B at 36.5 tok/s decode on an RX 7900 XT 20GB, with MTP speculative decoding (acceptance τ≈1.94).
Setup is the hipfire runtime (v0.4.2.1+) with MQ4 weights and ROCm 7.1; the model fits in ~17.5 GB VRAM at 8K context, and 49K context with MTP is the recommended daily setting.
Prefill holds ~1,100 tok/s at 16K, and decode is 52–59 tok/s at 16–49K context. Offloading layers to system RAM past that drops decode to ~16–31 tok/s. The user claims ~2.2x faster end-to-end than Q4_K_S GGUF on llama.cpp, and notes the .mq4 files only load in hipfire and were tested only on gfx1100.