Qwen3.8 125B (6B active) Swift-1.5
on Strix Halo 64GB · Strata
Summary
User reports running Swift-1.5-Qwen3.8-Flash-Next at about 500 t/s prompt processing and 45 t/s generation on a 64GB Strix Halo box.
Setup is Strata with an IQ2_XS GGUF quant on Linux (NixOS), with a lot of memory left free. IQ3_S was tried but decoding was 10 times slower.
The user calls it an upgrade over gufo and llama.cpp, and has not tried halogen.