llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3090 · llama.cpp · 131,072 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
20.0 t/s gen
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16
System RAM
128 GB
VRAM reported
24 GB

Use cases

creative-writingcoding

Summary

User reports about 20 t/s on an RTX 3090 with 128 GB of DDR5, running Qwen3.8-Flash-Next. Setup is a custom llama.cpp build from PR #27742, using the new qwen4exp architecture. The figure is approximate and likely generation speed, and the run is a showcase of a generated 3D voxel demo rather than a formal benchmark.