llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M3 Ultra 512GB · llama.cpp · 256,000 ctx

Apple hardware
Sep 18, 2026
Throughput
31.1 t/s gen · 558.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
System RAM
512 GB

Summary

User reports Qwen3.8-Flash-Next at 31.05 t/s generation and 558.83 t/s prompt processing on an M3 Ultra 512GB. Setup is llama.cpp through llama-swap with the unsloth Q4_K_XL GGUF at 256,000 context, tested with llama-benchy. Prompt processing measured at pp1000 @ d1000 with 3312 ms time to first response; generation measured at tg500 @ d1000 with a peak of 31.67 t/s.