llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 5090 · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 4, 2026
Throughput
20.0 t/s gen
Quant
Q4_K_XL (GGUF)
System RAM
128 GB
VRAM reported
56 GB

Use cases

coding

Summary

User reports 20 t/s average with MTP running a model in an FPS game built with it, on a 5900x CPU, 128 GB DDR4 RAM, an RTX 5090 and an RTX 4000 PRO with 32+24 GB VRAM.