llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3090 · llama.cpp · 204,800 ctx

NVIDIA hardware
Sep 5, 2026
Throughput
15.8 t/s gen · 189.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16
System RAM
128 GB
VRAM reported
24 GB

Summary

User asks for config optimization advice, reporting prompt processing at ~189 t/s and generation at ~15.8 t/s. The setup splits a MoE model with 42 expert layers on CPU.