Qwen3.8 27B
on NVIDIA RTX 3090 · vLLM · 262,144 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-27B at 382 t/s on an RTX 3090 when reproducing context, and about 133 t/s on real chat prompts.
Setup uses an fp8 KV cache, int8 activations, DFlash2 block drafting, lookup-augmented drafting, prefix caching, split-KV verify attention, and KVarN for 262k context.
Quality is unchanged, with GSM8K at 96.5%.