Qwen3.8 27B

User reports running Qwen 3.8 27B FP8 on a single RTX PRO 6000 Blackwell 96GB with vLLM, shared by a small group of developers for coding agents. Setup uses vLLM with prefix caching and speculative decoding. In its first week the node processed 2B tokens, with two users alone accounting for roughly 950M and 900M tokens. Per-user throughput while sharing the node is 60-88 tok/s. The user reports 0 preemptions, 0 queued requests and 38.6% peak KV cache usage, and notes the node is not yet saturated.