llamaperf
Sep 18, 2026
Throughput
7-8 t/s gen · 110.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4

Summary

User reports Qwen3.8 Flash-Next Q4 at 7-8 t/s generation and 110 t/s prompt processing on dual RTX 3060 cards. No engine, context length, or KV cache quant is stated. User asks whether a used RTX 4070 or RTX 5060 Ti 16GB paired with a 3060 could match RTX 3090 generation speed, and says the current 7-8 t/s is not enough.