llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M5 Max 128GB · ijah

Tone: positiveApple hardware
Oct 19, 2026
Throughput
90-110 t/s gen
Quant
EXL3 5b-6/8b (EXL3)
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next at roughly 100 tok/s (90-110 through the server) on an M5 Max 128GB with the new ijah engine. Setup uses EXL3 trellis weights at 5b-6/8b, about 6% behind oMLX but with 5-bit experts. User says the quant is about 4-5x closer to bf16 than Jundot's oQ4e (KLD 0.033/0.009/0.015 vs 0.128/0.036/0.078) and about 2x closer than Sushi-4bpw. With Inco's DFlash2 drafter the user reports about 120 tok/s but has not verified it yet.