llamaperf
Oct 15, 2026
Throughput
176.0 t/s gen · 6450.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4
System RAM
64 GB

Summary

User reports 176 t/s decode and 6,450 t/s prefill with Qwen3.8 Flash-Next Q4 on 2x R9700 with 64GB DDR5. Setup uses Deadcode's Radiance inference engine, optimized for 2x R9700, with a Q4 quant. Benchmark tool is BetterBench.