Qwen3.8 27B
on NVIDIA RTX 5090 · NInfer · 555,000 ctx
Sep 9, 2026
Use cases
long-contextagenticcoding
Summary
User reports a fork of NInfer with a custom NVFP4 KV cache, YaRN context extension to 555k, multi-level prefix reuse with a host KV safety net, tool calling improvements, and monitoring.
Benchmarks show decode at 117 tok/s at 400k+ context, cold prefill of 260s for 414k tokens at 1600 tok/s, H2D restore in 0.4s, and 30GB of host KV.
Quality results show LongBench matching int8, AIME at 96.7%, and needle-in-haystack at 100%.