Use cases
codingtool-uselong-context
Summary
User reports Qwen3.8 Flash-Next on a Strix Halo 128GB (Framework Desktop) at 1400 t/s prefill and about 50 t/s generation, which they call good enough for their usage.
Setup is Gufo, serving the model alongside embedding and STT/TTS models; the 50 t/s is described as an average.
The user is weighing selling their RTX 5090 to scale out for three concurrent users with 2-3 sessions each at 200k context, and is leaning toward buying a second Strix Halo.