llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · 700,000 ctx

Tone: positiveNVIDIA hardware
Oct 11, 2026
Throughput
100-120 t/s gen
Quant
IQ3_XXS (GGUF)
System RAM
64 GB
VRAM reported
32 GB

Use cases

codinglong-context

Summary

User reports running Qwen3.8 Flash-Next IQ3_XXS at a 700K context window on an RTX 5090 32GB with 64GB system RAM, completing a project in one continuous session without context compaction. Generation speed is given as approximately 100-120 tokens/sec, with vision disabled. The model ran with CPU offload given the 125B size on a single 32GB card. User notes possible quality degradation at extreme context lengths and estimates 1M context might be possible at around 80 tokens/sec, though untested.