llamaperf
Sep 20, 2026
Throughput
60.0 t/s gen
Quant
Q4_K_M (GGUF)
VRAM reported
96 GB

Summary

User reports Qwen3.8 Flash-Next at ~60 t/s on a rented RTX Pro 6000 Blackwell 96GB. Setup uses the Q4_K_M GGUF, which the user notes is not efficient for this card but was chosen because abliterated models that fit the memory are limited. The rental costs about $30/day on Vast, and the user is asking which hardware configuration would offer the best price and versatility for future model generations.