Qwen3.8 125B (6B active) Flash-Next
on 2× AMD Strix Halo 128GB · llama.cpp · 256,000 ctx
Summary
User reports Qwen3.8 Flash-Next at 60+ tok/s decode and 2000+ tok/s prefill on Strix Halo 128GB plus an R9700 32GB.
Setup is a modified llama.cpp (llama-halo-hybrid) with Q4_K_XL weights, splitting dense layers and KV cache to the GPU while the APU runs the rest, supporting full 256k context.
The user says it beats DGX Spark running the same model, with the Swift-1.5 variant performing slightly better, and recommends Strix 128GB plus R9700 over Gorgon Halo for price and performance.