Qwen3.8 125B (6B active) Flash-Next
on NVIDIA V100 32GB · llama.cpp · 262,144 ctx
Oct 4, 2026
Summary
User reports Qwen3.8-Flash-Next Q8_0 at ~52 tokens per second prompt processing and ~10 tokens per second generation on a V100 32GB.
Setup is llama.cpp with a 262144-token context, --cpu-moe and -ngl 64, on a machine with 128GB system RAM; the GPU drew 95.85 W at 48% utilization with 14206 MiB of its 32768 MiB in use.
Both throughput figures are given as approximate.