llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5060 Ti 16GB · QwFN-hybrid · 16,384 ctx

NVIDIA hardware
Oct 8, 2026
Throughput
620.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
32 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next 125B on an RTX 5060 Ti 16GB with about 620 tok/s prompt processing at 16K; decode is given only per workload, 26.4 tok/s code, 21.3 agent, 21.8 reasoning and 17.7 at 21K context, with no overall figure. Setup is the author's QwFN-hybrid engine on one RTX 5060 Ti 16GB, the 76GB model's experts offloaded across VRAM, 32GB DDR5 system RAM and an NVMe SSD. llama.cpp on the same machine prefilled at about 165 tok/s at 16K. The author replays workloads token by token against llama.cpp, and the current release passes 4/5 parity gates.