llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M5 Pro 64GB · Slipstream · 130,000 ctx

Tone: positiveApple hardware
Oct 1, 2026
Throughput
40.8 t/s gen
Quant
Q4_0 (GGUF)
System RAM
64 GB

Use cases

codingmathagentic

Summary

User reports Qwen3.8-Flash-Next at 40.8 tok/s on an M5 Pro 64GB Mac using the Slipstream engine. Setup is Slipstream with Q4_0 GGUF weights and SSD expert streaming, running the 95.5 GiB model on a single 64GB machine. The figure is the average across six reasoning and coding tasks, compared to 23.1 tok/s in a llama.cpp fork (1.76x speedup). Decode stays between 33 and 44 tok/s out to 130,000 tokens across 3,086 live requests. An optional Swift KV-sparse variant scores 70.3% overall on 145 paired evaluation problems versus 67.6% for the original.