llamaperf

Qwen3.8 27B

on M4 Max 128GB · 256,000 ctx

Apple hardware
Sep 7, 2026
Throughput
15.2 t/s gen
System RAM
128 GB

Use cases

long-contextagentic

Summary

User benchmarks Qwen3.8 27B on an M4 Max 128GB across five runtime and quant stacks at contexts from 32K to 256K. The stacks are oMLX AWQ 5-bit, oMLX oQ8e, mlx-dspark, and MTPLX 4-bit and 8-bit. Best decode at 256K is oMLX AWQ 5-bit at 15.2 t/s, while MTPLX collapses at 256K. Prefix caching is crucial for effective speed.