llamaperf

Qwen3.8 125B (6B active) Flash-Next Uncensored

on NVIDIA RTX 5090 · Strata · 212,000 ctx

Tone: positiveNVIDIA hardware
Oct 9, 2026
Throughput
135-153 t/s gen
Quant
NVFP4 (GGUF)
KV cache
INT8
System RAM
136 GB
VRAM reported
32 GB

Use cases

codingagenticlong-context

Summary

User reports daily driving Qwen 3.8 Flash-Next MoE (uncensored NVFP4) on an RTX 5090 with 136 GB DDR5 RAM, seeing 135-153 tok/s decode over 8 hours of agentic coding. Setup is Strata (NVFP4 fork) with NVFP4 MoE weights, BF16 embeddings, FP8 PLE and INT8 dynamic paged KV cache at up to 262k context; 22.3 GB of expert slots held in VRAM with the remainder paged from a 64 GB host RAM arena. Decode stayed flat from 50k to 212k context (r = +0.005), with 134.5 tok/s at 52k, 146.7 tok/s at 205k and 141.2 tok/s at 212k; MTP speculative decoding had a 79.60% acceptance rate and the MoE VRAM cache hit rate averaged 89.9%. Over 2,411 requests the KV cache hit rate was 99.31%.