llamaperf
Oct 11, 2026
Throughput
54.9 t/s gen · 982.2 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)

Summary

User asks whether Qwen3.8 27B Q8_0 numbers on a W7900 are reasonable. Table gives mean prefill 982.2 tok/s, mean generation 54.9 tok/s and mean server TTFT 2.27 s at depth 0, with 32K and 128K rows kept in features. No engine, context length or KV cache quant stated.