Qwen3.8 27B
on NVIDIA RTX 4090 · NInfer · 262,144 ctx
Oct 5, 2026
Use cases
codinglong-contextagentic
Summary
User compares Qwen3.8-27B dense on NInfer against Qwen3.8-Flash-Next IQ2_XS on Strata 0.1.39, both on one RTX 4090 24 GB with 262K context and MTP.
The 27B decodes at 127-140 tok/s with rk4v4-e8 KV and 23,134 MiB peak VRAM; the MoE decodes at 173-185 tok/s with q4_0 KV in VRAM and experts in host RAM, peaking at 23,936 MiB. Recall at 55K/117K/200K is 3/3 for both, with the 27B at 3,037/2,391/1,857 prompt tok/s and the MoE at 3,494/3,904/3,833.
On three graded tickets the 27B scored 112/150 versus 86/150 for the MoE. The user attributes the difference to cache reuse: 88.5% for the 27B, including one turn serving 172,343 of 172,578 tokens from cache with first token in 524 ms, against 32% for the MoE, whose typical turn re-read 107K tokens in 28 s with conversation cache off on 32 GB RAM. Limits are n=1 per ticket, one grader model, and the MoE ran first.