Qwen3.8 125B (6B active) Flash-Next
on NVIDIA Tesla P100 16GB · llama.cpp · 80,000 ctx
Oct 12, 2026
Use cases
codingagentictool-use
Summary
User reports Qwen3.8-Flash-Next at 5.84 t/s generation and 56.10 t/s prompt processing on an Nvidia P100 16GB.
Setup is llama.cpp with IQ3_XXS quant and 80K context, running on an HP Z440 workstation with Intel Xeon E5-1650 v3 and 64GB RAM.
The model is a 125B MoE with 6B active parameters, partially offloaded to CPU. User notes it is slow but works for non-time-critical tasks like email sorting and calendar management.