llamaperf
Oct 5, 2026
Throughput
96.2 t/s gen
Quant
EXL3 3.0 bpw (EXL3)

Summary

User reports Qwen3.8-27B at 96.2 tok/s on prose and 141.1 tok/s on code on an RTX 3090. Setup is SGLang with EXL3 3.0 bpw weights and an MTP draft model, single request. The figures come from the trellis-serve project's registry recipes; the same table also lists Qwen3.6-35B-A3B at 251.7 tok/s prose and 357.9 tok/s code on the RTX 3090, and Qwen3.8-27B at 91.2 tok/s prose and 66.1 tok/s code on an Intel Arc Pro B70.