llamaperf

Ornith

on M1 Ultra 64GB · oMLX · 131,072 ctx

Tone: mixedApple hardware
Sep 26, 2026
Throughput
35-60 t/s gen · 500-1100 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
oQ8e
System RAM
64 GB

Use cases

coding

Summary

User reports Ornith (1.0 or 1.5) at 35-60 t/s generation and 500-1100 t/s prefill on an M1 Ultra 64GB, reaching 70 t/s with MTP. Setup is oMLX with oQ8e quant, 131K context, ANE disabled, native MTP enabled, fp16 models, and no KV cache quantization. User also tested Qwen 3.8 27B, which starts at 28-30 t/s but drops to 10-15 t/s with prefill of 100-190 t/s, making it unusable for long coding tasks. User asks whether Qwen 3.8 Flash Next is usable on 64GB Macs and which engine to use.