Qwen3.8 27B
on NVIDIA RTX 5090 · SGLang
Summary
User reports Qwen3.8 27B at an average 208.2 tok/s on a single RTX 5090 32GB.
Setup is SGLang in Docker with the gittensor NVFP4 build and the DSpark speculative drafter, served over an OpenAI-compatible API.
Five runs of 256 tokens with thinking on ranged from 148.3 tok/s (cold start) to 232.4 tok/s, averaging 208.2; the user says it sits in the 220s once warm and peaks above 230.