Qwen3.8 125B (6B active) Flash-Next Uncensored
on NVIDIA RTX 5090 · Strata · 212,000 ctx
Oct 9, 2026
Use cases
codingagenticlong-context
Summary
User reports daily driving Qwen 3.8 Flash-Next MoE (uncensored NVFP4) on an RTX 5090 with 136 GB DDR5 RAM, seeing 135-153 tok/s decode over 8 hours of agentic coding.
Setup is Strata (NVFP4 fork) with NVFP4 MoE weights, BF16 embeddings, FP8 PLE and INT8 dynamic paged KV cache at up to 262k context; 22.3 GB of expert slots held in VRAM with the remainder paged from a 64 GB host RAM arena.
Decode stayed flat from 50k to 212k context (r = +0.005), with 134.5 tok/s at 52k, 146.7 tok/s at 205k and 141.2 tok/s at 212k; MTP speculative decoding had a 79.60% acceptance rate and the MoE VRAM cache hit rate averaged 89.9%. Over 2,411 requests the KV cache hit rate was 99.31%.