llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3090 · llama.cpp · 65,536 ctx

NVIDIA hardware
Sep 7, 2026
Throughput
15-19 t/s gen · 550.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
KV cache
Q4
Flash Attention
on
System RAM
192 GB
VRAM reported
24 GB

Summary

User reports Qwen3.8 Flash Next at 15-19 t/s generation and 550 t/s prompt processing on dual RTX 3090s with a Threadripper Pro. Setup is llama.cpp with speculative decoding using draft-mtp.