Qwen3.8 27B
on AMD RX 7900 XTX · llama-server-fpx
Summary
User reports Qwen3.8-27B-ROCmFP4-FAST decoding at 12.8-13.2 t/s on an AMD RX 7900 XTX 24 GB, with later runs at 16.5-18.1 t/s, against an expectation of about 75 t/s.
Setup is llama-server-fpx (ROCmFPx fork, Vulkan backend) with the 13.5 GiB GGUF, -ngl 999, flash attention on, and MTP speculative decoding (--spec-type draft-mtp, --spec-draft-n-max 4).
Prompt processing is 42.7 t/s. MTP acceptance is 70-73%, later 79%. The machine is a Dell 5820 Tower with an Intel W-2125 and 128 GB RAM, 64 GB of it passed to a Docker LXC.