Qwen3.8 27B
on NVIDIA RTX 3090 · SGLang
Oct 5, 2026
Summary
User reports Qwen3.8-27B at 96.2 tok/s on prose and 141.1 tok/s on code on an RTX 3090.
Setup is SGLang with EXL3 3.0 bpw weights and an MTP draft model, single request.
The figures come from the trellis-serve project's registry recipes; the same table also lists Qwen3.6-35B-A3B at 251.7 tok/s prose and 357.9 tok/s code on the RTX 3090, and Qwen3.8-27B at 91.2 tok/s prose and 66.1 tok/s code on an Intel Arc Pro B70.