llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5060 Ti 16GB · Basalt · 128,000 ctx

Tone: positiveNVIDIA hardware
Oct 15, 2026
Throughput
75.0 t/s gen · 1200.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q2 (GGUF)
KV cache
Q4
System RAM
32 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 Flash-Next at 75 tok/s generation and 1200 tok/s prefill at 128k context on an RTX 5060 Ti 16GB. Setup is Basalt (a Strata fork for Blackwell) with a Q2 quant and Q4 KV cache, on a system with 32GB RAM and about 5GB left for the OS. User says the model is used as a dedicated coding agent and had to add a build flag to allocate more RAM.