llamaperf
Sep 23, 2026
Throughput
47.1 t/s gen
Quant
UD-IQ4_XS (GGUF)
MTP (Multi-Token Prediction)
on
System RAM
128 GB

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next at 47.1 t/s on an AMD Strix Halo 128GB, up from 16.8 t/s baseline, for file rewrite at about 8k context. Setup is llama.cpp on ROCm 7.1 with the UD-IQ4_XS GGUF, using GPU TOP_K improvements, native MTP speculative decoding and ngram-mod augmentation. New code at 8k context reached 31.7 t/s; at about 24k context, file rewrite reached 28.6 t/s and new code 25.4 t/s, against baselines of about 15 t/s.