Qwen3.8 Swift-1.5-abliterated
on 2× AMD RX 7900 XTX · Strata · 262,144 ctx
Summary
User reports peak prompt processing of ~2500 t/s on prompts over 80k tokens and decode of 90-120 t/s with Swift 1.5 IQ3_S on two RX 7900 XTX cards in eGPU enclosures over OCuLink PCIe 4x4, on an HX370 mini PC with 64GB DDR5 5600.
Setup is Strata 1.4.4.1 with int8 KV cache, 262144 max context, MTP speculation, expert cache 7000, 20480 KV resident, 50 GiB resident budget, and MMAP to reduce system RAM pressure; vision is enabled.
The post is mainly a guide to building a tuned HIPblasLt table for the user's own hardware; the throughput figures are given as ranges.