Qwen3.8 27B
on NVIDIA RTX 5090 · llama.cpp · 120,000 ctx
Oct 3, 2026
Summary
User compares Qwen3.8 27B across four setups on an RTX 5090 at 120k context, reporting decode speeds of ~147 t/s (ninfer non-NVFP4 with MTP), ~141 t/s (llama.cpp Q4_K_M with MTP), ~155 t/s (ninfer NVFP4 with MTP), and ~68 t/s (llama.cpp Q4_K_M without MTP).
Setup is llama.cpp with Q4_K_M GGUF, thinking on at xhigh, default sampling, one run per setup.
Stock llama.cpp without MTP is less than half as fast as ninfer, but MTP lifts it from 68 to 141 t/s. NVFP4 had the highest t/s but wrote the most tokens, finishing third on wall-clock time. All four runs produced working games; only the NVFP4 build could be won legally. User is sticking with the non-NVFP4 ninfer build.