llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M5 Ultra 256GB · oMLX · 1,024 ctx

Tone: mixedApple hardware
Oct 24, 2026
Throughput
141.0 t/s gen · 3906.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q6_K_XL (GGUF)
System RAM
256 GB

Use cases

coding

Summary

User benchmarks Qwen3.8-Flash-Next at 141.0 t/s generation and 3906.4 t/s prompt processing on an M5 Ultra 256GB. Setup is oMLX with a Q6_K_XL GGUF at a 1024-token prompt, single request, no speculation. Decode ranges from 67.6 to 197.3 t/s across the 1024 to 200000-token prompt sweep. Continuous batching reaches 316.4 t/s aggregate at 4 concurrent requests. User says opencode runs fast and responsively but code quality still has room for improvement.