Qwen3.8 27B
on NVIDIA RTX 5090 · SGLang · 175,064 ctx
Sep 7, 2026
Summary
User reports prose decode at ~144 t/s and code at ~256 t/s, with parallel x2 at ~261/451 t/s.
Prefill TTFT runs from 0.33s at 5k to 23.46s at 150k, with a 175k KV pool and a host-RAM KV tier that resumes a ~100k conversation in ~1s.
External evals give GPQA Diamond 84.8%, GSM8K 96.8%, MATH-500 95.6%, AIME 2024 83.3%, HumanEval 56.7% and MBPP 75.0%. The run uses the froggeric template with xhigh reasoning and a 16k think cap.