llamaperf

Qwen3.8 27B Swift-1.5

on M5 Max 40-core · Inco Splash

Tone: positive
Oct 9, 2026
Throughput
89.8 t/s gen
Quant
4-bit

Use cases

codingcreative-writing

Summary

User reports a fork of the Splash engine, called Splish, optimised for the M5 Max. On a 40-core M5 Max with 4-bit models, Swift-1.5 went from 74.7 to 89.8 tok/s at a single request with tuned kernels. Setup uses the Splash engine with 4-bit models and kernel choices tuned for the 40-core M5 Max. The fork is roughly 1.25x faster at a single request and up to 1.5x faster at 2-4 requests. In real-world short story prompts, speed went from about 45-51 tok/s to 56-64 tok/s. Qwen3.6-35B-A3B saw speedups of +5% / +18% / +22% / +18% at 1-4 requests. Whole-file edits for coding agents improved by +24% to +42%.