Qwen3.8 27B
on NVIDIA RTX 5090 · llama.cpp · 113,920 ctx
Summary
User benchmarks DFlash2 quants and MTP, with the best speed at 154.08 t/s for Q4 at n-max 7.
The best balance is DFlash2 Q2 at n-max 5, reaching 137.19 t/s with 121k context. MTP tops out at 128.32 t/s at n-max 6.
Context size is set to 113920 in the config.