llamaperf

Tencent-HY4 Flash

on M5 Ultra 256GB · oMLX

Tone: positiveApple hardware
Nov 19, 2026
Throughput
26.0 t/s gen
Quant
oQh8-BF16
System RAM
256 GB

Summary

User reports Tencent Hy4-flash running at about 26 tokens per second on an M5 Ultra with 256 GB of memory. Setup is a preliminary oMLX pull request, run from the command line, using an 8-bit oQh8-BF16 conversion of the model that needs about 175 GB of memory free. Long prompts work but get very slow, and the image part is not connected yet, so it is text only. A 128GB version is planned.