Qwen3.8 125B (6B active) Flash-Next
on M4 Max 128GB · llama.cpp · 32,768 ctx
Summary
User reports Qwen3.8 Flash-Next at 27.33 tok/s decode on an M4 Max 128GB.
Setup is llama.cpp (current main, 62acc89) with UD-Q3_K_XL GGUF at 32768 context, -ngl 99, single stream. The MTP head is not exported in any GGUF of this model, so no speculative decoding.
On the same box an MLX pack with MTP reached 90.07 tok/s and 45.01 tok/s with MTP off. The GGUF is 90 GB of weights versus 46.9-49.1 GB resident for the MLX pack. Quants are not matched and the MLX pack is an abliterated fine-tune, so this is a throughput comparison only. LM Studio cannot load the model on either its GGUF or MLX runtime.