Qwen3.8 125B (6B active) Flash-Next

User benchmarks a MoE CPU-offload patch for ExLlamaV3 that streams expert weights directly from a page-locked shared arena, removing the host staging memcpy. On an RTX 4090 with a Ryzen 9 7900X, the Qwen3.8 Flash-Next 125B-A6B model at 4.05bpw reaches 1944 tok/s prefill at 4096 context and 33.6 tok/s decode at context 0 on Windows, roughly doubling upstream prefill. Setup is ExLlamaV3 with EXL3 4.05bpw weights, 32768 context, chunk size 4096, and CPU-offloaded MoE experts. The patch is PCIe-bound at 26-30 ms per ~1 GiB layer. Prefill figures are medians of 5 runs with min-max ranges; WSL2 reaches 2044 tok/s at 4096 context. Decode varies more with machine state than with the patch.