Qwen3.8 27B

User reports 73.2 t/s generation. Source evidence (verbatim): Source: https://gist.github.com/PierpaoloPernici/f1d1382f8e357b4faffb1a9f584cc1df # vLLM vs NInfer: Qwen3.8-27B benchmark on an RTX 5090 Hardware: NVIDIA GeForce RTX 5090 32 GB, driver 610.57.04, CachyOS Linux. Engine vLLM 0.27.1, weights NVFP4 (Qwen3.8-27B NVFP4 for RTX 5090, modelopt), fp8 KV cache, max-num-seqs 16, tool-eval-bench harness, PP=2048 TG=128. Plain run without MTP, cold, no prefix caching, concurrency 1: client decode 73.2 tok/s at context depth 0, 62.7 at 4K, 54.0 at 8K, 40.4 at 16K, 24.4 at 32K. vLLM server-side prefill is about 6,000 to 18,000 tok/s. With MTP speculative decoding @3 at concurrency 1: 117.3 tok/s at depth 0. At concurrency 4 without MTP: 217.3 aggregate tok/s at depth 0.