Summary
User reports DeepSeek V4.1 Flash at 49.9 tok/s decode on one RTX PRO 4500 32 GB, median of three runs.
Setup is the author's FLE engine fork with a 2-bit IQ2_XXS GGUF (232 GiB on disk), experts in 120 GB of system RAM with the busiest on the GPU, and DeepSeek's DSpark draft model proposing five tokens. Without the draft model decode is 37.2 tok/s.
Against the original weights the 2-bit quant has KL divergence 0.248 and top-1 agreement 83.5 %. Speed is bound by DDR5-4800 memory across four sticks. With thinking on at 16k context, a budget of 8000 tokens lets both test tasks finish, while at 64k without a budget both thought 60,000 tokens and never answered. The author also notes Qwen3.8-Flash-Next 125B runs from 16 GB at about 15 tok/s and 91 tok/s on the 32 GB card.