llamaperf

Qwen3.8 27B

on M5 Pro 64GB

Tone: mixedApple hardware
Sep 13, 2026
Throughput
20.0 t/s gen
System RAM
64 GB

Summary

User reports Qwen3.8 27B at around 20 t/s sustained on an M5 Pro 64GB, with about 30 t/s in the first 2-4k tokens. User finds it unbearably slow, possibly because the model thinks so much. User also tried antirez's DS4 with DeepSeek V4 Flash and gets around 8 t/s sustained, which they call slow and basically unusable.