Qwen3.8 27B

User reports Qwen3.8-27B at 127 tok/s single-stream decode on one RTX 3090 at 250 W. Setup is vLLM 0.30.0 with 38 custom patches, int8 tensor-core GEMMs, speculative decoding with MTP or DFlash2 drafting at 7 drafts per pass, and KVarN 4/2-bit KV cache at 150k-262k context. Decode reaches 381 tok/s at 25k context when the answer quotes the prompt. At 64 concurrent requests the aggregate is about 1,035 tok/s decode and 948 end to end. Prefill is about 1,440 tok/s, or 1,850-1,940 tok/s depending on int8 activation settings. The card is shared with training jobs.