llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× 2x R9700 AI PRO 32GB · vLLM - Radiance · 262,144 ctx

Tone: mixed
Oct 14, 2026
Throughput
150.0 t/s gen · 2000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4bit
System RAM
128 GB
VRAM reported
64 GB

Use cases

coding

Summary

User compares Qwen3.8 Flash-Next 4-bit against Qwen3.8 27B FP8 on a coding task, both run on 2x R9700 AI PRO 32GB (64GB total VRAM) with vLLM - Radiance. Flash-Next averaged ~2000 prefill and ~150 generation t/s at 262k context and finished in about 30 minutes, but produced a messy, unusable WebUI. The 27B FP8 averaged ~1500 prefill and ~100 generation t/s and took about 60 minutes, but produced a mostly working result. User notes the speeds are real work averages, not benchmarks, and concludes a dense model outperforms the MoE on the same hardware.