llamaperf

Tencent-HY4

3 reports

Run Tencent-HY4 yourself? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance for Tencent-HY4

Filter this model’s reports by setup →
Tone: mixedNVIDIA hardware
prompt processing (prefill):
3450.0 tokens/s
quant:
NVFP4 (NVFP4)

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.

visionlong-contextmath

User reports Tencent Hy4 Flash running in Basalt 0.5.0 on an RTX 5090 plus RTX 5060 Ti, at about 84 t/s on prose, 172 t/s on structured output and around 3,450 t/s prefill. Setup is Basalt with an NVFP4 build, a single .basalt file needing roughly 95 to 100 GB of memory total, with more of it in VRAM being better. Speculative decoding uses DFly2. User says throughput is lower than Flash Next because Hy4 Flash has almost twice the weights per token at NVFP4, with more cache misses that are expensive; they expect maybe 10 or 20% more performance to unlock. Quantization hits it hard: the official Q4_K_M measured just below 87% same top 1 against BF16 and the NVFP4 build about 86%, versus above 91% for Flash Next NVFP4. Math felt better on Hy4, and 1M context and dynamic vision both work.

Nov 19, 2026

Tencent-HY4 Flash

NVIDIA RTX 3060 12GB · RustingStrata · 20,000 ctx

NVIDIA hardware
generation:
3.3 tokens/s
prompt processing (prefill):
11.6 tokens/s
quant:
IQ2_S/IQ2_XXS (GGUF)

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.

User reports Tencent Hy4-flash at 3.3 t/s generation after reading a 20,000-token prompt at 11.6 t/s on an RTX 3060 12GB with 32 GB RAM. Setup is RustingStrata, the user's own Rust GGUF engine, with an IQ2_S/IQ2_XXS 85 GB GGUF in two files; the model is far larger than the card and the RAM, so weights ran from system memory and NVMe. The 20,000-token prompt took 29 minutes to read. After a short prompt the model writes 4.3 to 5.1 t/s on CUDA. llama.cpp comparison was not possible because Hy4-flash support there is still a draft pull request.

Nov 19, 2026
Tone: positiveApple hardware
generation:
26.0 tokens/s
quant:
oQh8-BF16

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is shown only when the source reports it; generation speed cannot tell us time to first token. Check the full setup before comparing.

User reports Tencent Hy4-flash running at about 26 tokens per second on an M5 Ultra with 256 GB of memory. Setup is a preliminary oMLX pull request, run from the command line, using an 8-bit oQh8-BF16 conversion of the model that needs about 175 GB of memory free. Long prompts work but get very slow, and the image part is not connected yet, so it is text only. A 128GB version is planned.

Nov 19, 2026

Get a weekly email of new Tencent-HY4 reports on any GPU.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
Tencent-HY4 Flash
NVIDIA RTX 3060 12GB
IQ2_S/IQ2_XXS
RustingStrata
20,0003.3 tokens/s
Tencent-HY4 Flash
M5 Ultra 256GB
oQh8-BF16
oMLX
Not reported26.0 tokens/s