Qwen3.8 27B Swift-1.5
on AMD RX 9060 XT 16GB · llama.cpp · 98,304 ctx
Use cases
codingagentictool-usevision
Summary
User reports running Swift-1.5-Qwen3.8-27B at IQ3_S on an RX 9060 XT 16GB, with eval in the mid 20s t/s and prompt processing between 550 and 231 t/s.
Setup is llama.cpp (llama-server) with MTP draft speculation, q5_0 K and q4_1 V caches, 98304 context, all layers on the GPU and the mmproj kept on the CPU. Draft acceptance was around 0.6-0.8.
A web-search agent request took 2m 10s end to end; the user has seen mid-40s eval at other settings. They ask whether to shrink context, add draft KV quantisation, and how to handle vision.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 27B at 4-bit by hardware
- NVIDIA RTX 309024 GB67.0 t/s · one run
- 37.5 t/s · one run
Bars are medians on one scale, 0 to 67.0 tokens/s. Press ▶ to watch text arrive at a row's speed.
Models most run on the AMD RX 9060 XT 16GB
- Qwen2.5 14B4-bit33.5 t/s · one run
- Qwen3.8 27B3-bit30.0 t/s · one run
Bars are medians on one scale, 0 to 33.5 tokens/s. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD RX 9060 XT 16GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →