Qwen3.8 125B (6B active) Flash-Next

User reports Qwen3.8-Flash-Next on two RTX 3090s with 128 GB RAM, reaching 3,401–3,413 tok/s prefill and 84.2–88.8 tok/s decode on a 131,099-token prompt. Setup is vLLM with W4A16 AutoRound weights, BF16 KV cache, FP8 PLE table, MTP3 speculative decoding, and CPU expert offload. The 64 GB RAM profile runs both cards with 64 GB system RAM, keeping 88 experts per layer on each GPU and streaming the rest from RAM; prefill uses 8,192-token chunks. A single RTX 3090 with 64 GB RAM reaches 2,106 tok/s prefill and 47.4 tok/s decode at 131K context.