llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3060 12GB · llama.cpp · 65,536 ctx

Tone: mixedNVIDIA hardware
Sep 7, 2026
Throughput
12-15 t/s gen · 200.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16
System RAM
256 GB
VRAM reported
12 GB

Summary

User reports Qwen 3.8 Flash Next at 12-15 t/s on an RTX 3060 12GB in a Thinkstation P520 with 256GB RAM, at 65k context. Setup is llama.cpp server with the model offloaded to GPU at --n-gpu-layers 999 and MoE experts on CPU at --n-cpu-moe 48. The user notes the model is slow and low context, but output quality is much better than the previous Qwen 3.6 35B A3B. Performance degrades significantly when the system is busy.