llamaperf

Kimi Linear-48B-A3B / native TG128 / backend unknown

on AMD Strix Halo 128GB · llama.cpp / unknown / build unknown

AMD hardware
Oct 13, 2026
Throughput
72.0 t/s gen
Quant
Q4_K_M (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Kimi-Linear-48B-A3B at 72 t/s generation on one Radeon 8060S gfx1151 in an AMD Ryzen AI MAX+ 395 with 128 GB unified memory. Setup is native llama-bench with Q4_K_M, full GPU offload at ngl 999, batch 2048, 32 threads and flash attention 1. The 72 t/s is the tg128 phase, not simultaneous 512-in/128-out throughput; the source compares it to 53 t/s for the separate Q8_0 phase.