Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · Strata · 130,000 ctx
Summary
User reports Qwen3.8-Flash-Next at 57.4 t/s generation on Strata, versus 18.84 t/s with llama.cpp (Unsloth fork) on the same Hermes session.
Setup is Strata with UD-Q4_K_XL GGUF weights, FP16 KV cache and 130k context; llama.cpp ran the same files at 110k context. Strata read a 38,968-token prompt in 23 seconds where llama.cpp took about 10 minutes, and the user reports roughly 3x the generation speed.
The user notes expert cache hit was 94.5% with 1.3% of routed experts over PCIe, and that earlier builds gave only about 45 t/s.