llamaperf

Qwen3.8 27B

on M1 Max 64GB · Inco Splash · 256,000 ctx

Tone: positiveApple hardware
Sep 24, 2026
Throughput
39.1 t/s gen · 142.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4-bit
System RAM
64 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at 39.1 t/s average on an M1 Max 64GB, up from 18.9 t/s with stock Splash kernels. Setup is a ported Inco Splash engine with custom Metal kernels for the M1, 4-bit weights, DFlash speculative decoding, and a 256K context. The 39.1 t/s is the average of npanj's five-prompt Splash benchmark at 250 tokens with default reasoning. A real coding-agent session (opencode, 30K-89K context) ran at 19.5-36.5 t/s decode. Prompt processing was 142 t/s at 2K, 133 t/s at 8K, and 110 t/s at 32K. Four parallel requests reached 65 t/s total. The 35B MoE variant averaged 94.7 t/s with ~450 t/s prefill.