llamaperf

Qwen3.8 27B Splash-HQ

on M5 Pro 64GB · Inco Splash · 262,144 ctx

Tone: positiveApple hardware
Sep 21, 2026
Throughput
36.9 t/s gen
Quant
Q8 (Splash)
System RAM
64 GB

Use cases

mathcodinglong-context

Summary

User reports Qwen3.8 27B at 36.9 t/s average on an M5 Pro 64GB using the Splash engine with native 8-bit weights. Setup is Splash with speculative decoding, 27 GB native 8-bit model, evaluated at temperature 0.0 across five task domains; speeds range from 21.9 to 54.8 t/s. Context scaling tested to 190,016 tokens with decode speed staying between 21 and 33 t/s; cold prefill at 180k+ tokens takes 4-5 minutes.