Qwen3.8 27B

User benchmarks Qwen3.8-27B at 155.9 t/s decode on a ~40k-token prompt using two RTX PRO 4000 Blackwell 24GB cards in tensor parallel 2. Setup is NInfer v0.9.0 (ninfer-serve, CUDA) with a QUASAR mixed NVFP4/FP8 artifact, int8 KV cache, 262144-token context and DFlash2 speculative decoding with 7 draft tokens; GPUs are power-capped to 145 W each. A second long-context run gave 163.8 t/s decode and 5590 t/s prefill; prose decode was 111.1 t/s and short reasoning tasks averaged 204.7 t/s with 10/10 correct. A ~9k-token prompt had a median TTFT of 1.31 s. Timings are client-side, one request at a time.