llamaperf

Qwen3.8 27B

on M1 Max 64GB · Inco Splash · 2,048 ctx

Tone: mixedApple hardware
Oct 6, 2026
Throughput
33.1 t/s gen
Quant
4-bit group-64 (MLX)
KV cache
8-bit
System RAM
64 GB

Use cases

long-contextsummarizationcoding

Summary

User benchmarks Qwen3.8-27B at 33.1 tok/s decode on an M1 Max 64GB, comparing Splash, MTPLX M1 fork, MTPLX upstream, oMLX, and TensorFold across 2K to 256K context lengths. Setup is Splash 1.1.0-m1 with 4-bit group-64 MLX weights and 8-bit KV cache, speculative decoding enabled, single stream. Splash decodes fastest up to 64K (33.1 tok/s at 2K, 24.1 at 64K) and uses the least memory (26.2 GB peak at 128K). The MTPLX M1 fork had the shortest whole 3-turn conversation at every length (15% shorter than Splash at 128K) but peaked at 43.5 GB. Upstream MTPLX drops to 5.0 tok/s at 128K. The user forked MTPLX and wrote the benchmark.