Qwen3.8 125B (6B active) Flash-Next

User reports Qwen3.8-Flash-Next at 42.2 t/s on 4x Tesla V100-SXM2-32GB (128 GiB VRAM total). Setup is a llama.cpp fork with tensor parallelism, CUDA_VISIBLE_DEVICES=0,1,2,3, GGML_CUDA_ALLREDUCE=nccl and GGML_CUDA_P2P=1, at 16k context. The 156 GiB model runs on 128 GiB of VRAM. At full 256k context with --ctx-size 262144 -ncmoe 12 decode is about 21.8 t/s. An expert-cache pool sweep on qwen35moe (256 experts, 8 used, 40 layers, -ncmoe 99) gives 16.1 t/s off, 20.4 t/s at N=8, 30.3 t/s at N=32, 39.2 t/s at N=64 and 46.7 t/s at N=128, with hit rates of 47%, 62%, 71%, 77%, 85% and 89%. Gains are sublinear in bytes moved: a run that copies almost nothing still tops out near 76 t/s against 102 t/s with no offload. All decode figures are single-stream.