Qwen3.8 27B

User reports Qwen3.8-27B at 70.19 tok/s end-to-end (71.00 tok/s decode) for a single request on an RTX 3090. Setup is the RTX 3090 port of NInfer, a C++/CUDA inference runtime, with MTP3 speculative decoding at 61.13% acceptance, CUDA Graphs enabled and 1,024 output tokens per request, peaking at 19,641 MiB VRAM. At eight concurrent requests decode reaches 165.33 tok/s. Qwen3-35B-A3B runs at around 260 tok/s single-stream on the same setup, and over 400 tok/s on highly repetitive workloads.