llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5070 · llama.cpp · 10,000 ctx

NVIDIA hardware
Sep 7, 2026
Throughput
22.0 t/s gen · 25.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ1_S (GGUF)
VRAM reported
12 GB

Summary

User reports Qwen3.8-Flash-Next at 22.0 t/s generation and 24.96 t/s prompt processing on a single RTX 5070 with 12 GB of VRAM. Setup is llama.cpp with the IQ1_S quant at 10,000 tokens of context.