Qwen3.8 27B
on NVIDIA RTX 5090 · llama.cpp
Oct 5, 2026
Use cases
codingsummarizationtool-useagenticlong-context
Summary
User reports Qwen3.8 27B at roughly 148 tok/s on an RTX 5090 with MTP enabled.
Setup is llama.cpp with NVFP4 weights and MTP speculative decoding on a single 32GB card.
Without MTP the same model ran at about 72 tok/s, and a Q4_K_M build at about 70 tok/s. Other models tested: GPT-OSS 20B MXFP4 at about 311 tok/s, Qwen3.6 hybrid at about 250 tok/s, Gemma 31B QAT at about 68 tok/s, and Flash Next at about 199 tok/s.