Qwen3.8 27B
on M2 Ultra 192GB · llama.cpp · 131,072 ctx
Sep 7, 2026
Summary
User benchmarks Qwen3.8-27B at 22.38 t/s generation (tg128) and 360.22 t/s prompt processing (pp512) on a Mac Studio M2 Ultra with 192GB unified memory.
Setup is llama.cpp build b10450 llama-bench with the Unsloth UD-Q6_K_XL quant (24.13 GiB), flash attention on, q8_0 K and V cache and batch and micro-batch 2048.
The user serves the model through llama-server at 131072 context with MTP speculative decoding (draft-mtp, draft max 3), and gets around 16 t/s on the WebUI with a flappy bird game prompt.