llamaperf
Sep 7, 2026
Throughput
30.0 t/s gen · 230.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_K_XL (GGUF)
System RAM
192 GB
VRAM reported
24 GB

Summary

User compares DeepSeek-V4-Flash and Qwen3.8-Flash-Next. Setup is DeepSeek-V4-Flash lossless at 162 GB in Q8_K_XL on 4x RTX 3090 with 192 GB DDR4, reaching about 30 t/s and about 230 pp. User notes Qwen3.8-Flash-Next has no lossless Q8 available and would need 360 GB, and criticizes benchmark misleadingness due to the size difference.