Qwen3.8 27B
on M3 Ultra 256GB · Ollama
Use cases
summarizationvisionlong-context
Summary
User reports Qwen3.8 27B at 14.0 tok/s generation and 93.1 tok/s prompt processing on a Mac Studio M3 Ultra with 256GB unified memory.
Setup is Ollama with Q4_K_M (17GB) and five timed runs averaged; the predecessor qwen3.6:27b reached 28.6 tok/s on the same machine, and the 1-bit UD-IQ1_M quant (6.7GB) ran at 27.2 tok/s generation and 309 tok/s prompt processing in llama.cpp.
User notes the new hybrid attention architecture is slower per token but uses roughly a third the tokens per answer, so wall-clock per answer is close to a tie; community figures cited for Strix Halo (20.4 tok/s), dual RTX 3090 (~60 tok/s) and RTX 5090 (75-140 tok/s) are not the author's own measurements.