llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M5 Max 128GB · Strata · 245,000 ctx

Tone: positiveApple hardware
Oct 24, 2026
Throughput
74.0 t/s gen
System RAM
128 GB

Use cases

long-context

Summary

User compares Strata against oMLX running Qwen3.8-Flash-Next on a 128GB M5 Max, with Strata decoding at 74 tok/s versus 57.5 tok/s for oMLX at 245K context. Strata is a one-month-old engine built for this one model, running on Metal. The comparison holds one request at a time only, which the user notes as the current limitation.