Qwen3.8 27B
on M5 Max 128GB · oMLX · 8,192 ctx
Summary
User reports 50.3 t/s generation and 1084 t/s prompt processing.
Source evidence (verbatim):
Source: https://omlx.ai/benchmarks/performance/ogokptif
# Qwen3.8-27B-oQ5e-mtp on M5 Max (40c) - oMLX Benchmark
Hardware: Apple M5 Max (40-core GPU), 128 GB unified memory. Engine: oMLX v0.7.1.dev1. Model: Qwen3.8-27B-oQ5e-mtp, 5-bit. Multi-token prediction (MTP) is enabled with adaptive max depth 3, so this is a speculative decoding run; DFlash and SpecPrefill are disabled. Single request. At 8k context: 1,084 tokens/s prompt processing and 50.3 tokens/s token generation. At 4k context: 1,137 prompt and 58.4 generation; at 1k: 895.8 prompt and 54.6 generation; at 16k: 882.8 prompt and 75.5 generation.