llamaperf

Qwen3.8 27B

on M5 Pro 24GB · Inco Splash · 120,000 ctx

Tone: positiveApple hardware
Oct 27, 2026
Throughput
55.0 t/s gen · 448.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ3_XXS (GGUF)
System RAM
24 GB

Use cases

agentictool-use

Summary

User reports Qwen3.8-27B at about 55 t/s generation and 448 t/s prefill on an M5 Pro MacBook Pro with 24GB unified memory. Setup is the Inco Splash engine (v1.4.1) with the UD-IQ3_XXS GGUF (10.9GB), capped at 18GB memory for around 120k context. User's own KLD measurements give 89.5% top-1 agreement with mean KLD 0.0542, and they say Safari and Discord still run comfortably alongside it.