llamaperf

Qwen3.8 27B

on M5 Max 128GB · oMLX · 8,192 ctx

Apple hardware
Oct 18, 2026
Throughput
50.3 t/s gen · 1084.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
oQ5e
System RAM
128 GB

Summary

User reports 50.3 t/s generation and 1084 t/s prompt processing. Source evidence (verbatim): Source: https://omlx.ai/benchmarks/performance/ogokptif # Qwen3.8-27B-oQ5e-mtp on M5 Max (40c) - oMLX Benchmark Hardware: Apple M5 Max (40-core GPU), 128 GB unified memory. Engine: oMLX v0.7.1.dev1. Model: Qwen3.8-27B-oQ5e-mtp, 5-bit. Multi-token prediction (MTP) is enabled with adaptive max depth 3, so this is a speculative decoding run; DFlash and SpecPrefill are disabled. Single request. At 8k context: 1,084 tokens/s prompt processing and 50.3 tokens/s token generation. At 4k context: 1,137 prompt and 58.4 generation; at 1k: 895.8 prompt and 54.6 generation; at 16k: 882.8 prompt and 75.5 generation.