llamaperf

Qwen3.8 125B (6B active) Swift-1.5 Flash-Next

on M5 Ultra 96GB · Inco Splash · 262,144 ctx

Tone: positiveApple hardware
Oct 26, 2026
Throughput
144.6 t/s gen · 3444.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
System RAM
96 GB

Use cases

codingagentictool-uselong-context

Summary

User reports Qwen3.8 Flash-Next (Swift 1.5) at 144.6 tok/s decode and 3,444 tok/s prefill on a Mac Studio M5 Ultra 96GB, at a median context of 147.5K tokens. Setup is Splash with IQ3_S GGUF weights and a 262,144-token context window, driven by the DeepSeek Harness agent framework for agentic coding. With two concurrent requests combined decode is 200.4 tok/s (100.2 per request) and prefill 3,006 tok/s; with three it is 218.0 tok/s combined (72.7 per request) and 3,253 tok/s prefill, a result the user calls preliminary. The user is happy with the numbers and finds the model less lazy than Sol at troubleshooting.