Qwen3.8 125B (6B active) Flash-Next
on M1 Max 64GB · llama.cpp
Sep 7, 2026
Summary
User reports a custom Q4 quant with spliced tensors from Unsloth and AtomicChat quants, with MTP enabled giving +70% decode at 22 btps.
Setup uses custom metal-optimized sparse attention, with prefill reduced to 170 tps at 4K and 150 tps at 256K context.
Q4_0 MTP matches Q8_0 acceptance rates at half RAM.