llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · llama.cpp · 196,608 ctx

Tone: positiveNVIDIA hardware
Sep 3, 2026
Throughput
90.0 t/s gen
Quant
MXFP4 (GGUF)
KV cache
Q8
System RAM
128 GB
VRAM reported
32 GB

Use cases

coding

Summary

User reports MTP support merged in ik_llama.cpp, with decode at 90 t/s on code, up from 45 without. Draft acceptance is 93-99% on code and 60-65% on prose. The same test on an RTX Pro 6000 gives 85 to 113 t/s on code and 83 to 59 t/s on story, and on a 12 GB 4070 it gives 9.5 to 12.5 t/s on code.