Summary
User reports Qwen3.8 Flash-Next at 31.2 t/s decode on a single Tesla P100 16GB with PXA v3.1 Overdrive mode, using a 32 GB quant.
Setup is PXA with a 32 GB quant, experts cached on card and rest streamed, single request.
Overdrive off gives 20.0 t/s; two P100s reach 38.2 t/s, one V100 35.4 t/s, two V100s 55.7 t/s. Against Strata on the same P100, prose decode 31.1 vs 27.0 t/s, code 34.3 vs 34.1, prompt processing 4k 326 vs 226 t/s and 8k 338 vs 246 t/s.