llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3090 · llama.cpp · 261,888 ctx

Tone: positiveNVIDIA hardware
Sep 9, 2026
Throughput
33.3 t/s gen
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16
MTP (Multi-Token Prediction)
on
System RAM
128 GB

Use cases

long-context

Summary

User reports median decode improving from 30.2 to 33.3 t/s with radix-selection top-k fallback. A quality screen scored 238/240 correct against 235/240 for the control, with no regression detected.