llamaperf
Oct 16, 2026
Throughput
150.0 t/s gen · 4000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q5_K_XL (GGUF)

Summary

User reports Qwen3.8 Flash-Next at ~150 tok/s generation and ~4k prefill on two RTX 5090s. Setup is Strata with Q5_K_XL weights. User is considering selling one 5090 and buying four R9700s for roughly the same price, doubling VRAM, and asks how that would affect which models can be run and their performance.