Qwen3.8 27B
on NVIDIA RTX 5090 · llama.cpp · 48,000 ctx
Sep 28, 2026
Summary
User reports Qwen3.8 27B at 98.03 t/s generation and 2829.27 t/s prompt eval on an RTX 5090.
Setup is llama.cpp with UD-Q6_K_XL GGUF, 48000 context, draft-mtp speculative decoding (acceptance 0.47494, mean len 2.42).
User notes only 48k context fits on the RTX 5090 with this quant.