Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · llama.cpp · 160,000 ctx
Summary
User compares Qwen3.8 Flash-Next Q4_K_M at 160,000 context across a Strix Halo and a six-GPU machine. On Strix Halo with mainline llama.cpp 0.4.1 the run reaches 113.48 t/s prefill and 7.06 t/s generation.
Setup is llama.cpp with Q4_K_M weights, 103.68 GiB model, fully in the Strix Halo's 128GB unified memory.
At the same context the Gufo fork gives 1227.12 t/s prefill and 22.04 t/s generation, Halo Box gives 587.99 t/s and 21.24 t/s, and the pile of GPUs (2x RTX 5070 Ti, 2x RTX 5060 Ti 16GB, 2x RX 7900 XTX) gives 215.73 t/s and 16.29 t/s. User concludes Strix Halo shines for this model.