llamaperf
Sep 27, 2026
Throughput
60-100 t/s gen · 1600-2300 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Use cases

coding

Summary

User compares Qwen3.8 27B and Qwen3.8 Flash-Next on a coding task using dual RTX 5090 GPUs. Qwen3.8 27B completed the task in 5-10 minutes with infill ~2000-3000 t/s and output 100-150 t/s. Flash-Next took 2.5 hours with infill ~1600-2300 t/s and output 60-100 t/s, and continued running tasks for ~2 hours after the last code modification. User asks why Flash-Next is slower and what settings would speed it up.