llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · ignis

Tone: positiveNVIDIA hardware
Oct 12, 2026
Throughput
95-105 t/s gen
Quant
trellis 2.5bpw
VRAM reported
32 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next (125B MoE, 6B active) at ~95-105 tok/s on a single RTX 5090, with three lanes giving ~130 tok/s aggregate. Setup is the ignis engine with a trellis 2.5-bit expert quant (67 GB file), expert cache in VRAM (~17 GB) and experts in pinned host RAM (~38 GB) over PCIe 3.0. Quality: MMLU-Pro proxy 70.1% vs 73.7% for BF16, top-1 agreement with BF16 82-98% by domain.