llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5070 Ti Laptop 12GB · Flyweight

Tone: positiveNVIDIA hardware
Sep 18, 2026
Throughput
35.0 t/s gen · 475.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ1_S (GGUF)
System RAM
60 GB
VRAM reported
12 GB

Summary

User reports Qwen3.8 Flash-Next at ~35 t/s decode and ~475 t/s prefill on an RTX 5070 Ti Laptop 12GB with 60 GB system RAM. Setup is the Flyweight engine with an IQ1_S GGUF, running MoE experts on CPU or split with a hot set cached on the GPU. Other measurements on the same laptop: Qwen3.8 27B IQ2_XXS at ~40 t/s, DeepSeek-V4-Flash at 6-7 t/s, and Z-Image 1024x1024 in ~15 s with a 35B model loaded alongside.