Sep 25, 2026
Summary
User compares Qwen3.8 Flash-Next IQ4_XS against Qwen3.8 27B FP8 on a system with 64 GB DDR5 and 2x Radeon AI PRO R9700, serving both via vLLM.
Both models were run through a reduced quick eval with the same questions: MMLU-Pro 83.8% vs 75.0%, GPQA Diamond 42.5% vs 27.5%, GSM8K 97.5% vs 90.0%, German MGSM 92.5% vs 90.0%, and IFEval 89.6% for both.
The 250-case fast trial took 36m 27s on 27B FP8 and 2h 05m 47s on Flash-Next IQ4_XS. The user notes MMLU used only 80 random questions and the evals are not full, and that FP8 27B is around 4x faster than Flash-Next under concurrency.