llamaperf

Tencent-HY3 295B (21B active)

on M5 Max 128GB · llama.cpp · 24,576 ctx

Tone: positiveApple hardware
Aug 28, 2026
Throughput
32.4 t/s gen
Quant
UD128 (GGUF)
KV cache
Q8
System RAM
128 GB

Use cases

tool-use

Summary

User reports Tencent HY3 295B-A21B MoE at 32.4 t/s generation at empty context and 16.3 t/s at 16K context on Metal. Setup is llama.cpp with the UD128 quant (107 GB), a q8_0 KV cache, and 24K context. With MTP n=2, generation peaks at 38 t/s. Prefill runs 528 t/s at pp512 empty and 124 t/s at pp512 at 16K. User compares the result favorably to DeepSeek V4 Flash.