Qwen3.8 125B (6B active) Flash-Next

User benchmarks Qwen3.8-Flash-Next (125B-A6B) on a single RTX PRO 6000 Blackwell 96GB with 64GB host RAM, comparing vLLM, ExLlamaV3 and SGLang. vLLM with NVFP4/FP8 mixed checkpoint, INT4 PLE offload and MTP reaches 101.6 tok/s at 1k context and 98.9 tok/s at 32k, with prefill around 28k tok/s. ExLlamaV3 EXL3 is faster at short single-user chat (168.9 tok/s at 1k) but fails most requests at 32k concurrency. SGLang with a file-backed n-gram table decodes at 37-51 tok/s. The user notes the 27B incumbent stays in production due to larger KV capacity and reliable tool_choice enforcement.