llamaperf

Qwen3.5 122B (10B active)

on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown

AMD hardware
Oct 13, 2026
Throughput
22.4 t/s gen · 287.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Qwen3.5-122B-A10B at 22.4 t/s generation and 287 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory. Setup is llama.cpp with the Unsloth UD-Q4_K_XL quant, full offload, batch 2048 and flash attention, measured via llama-bench pp512 and tg128. The 287 t/s and 22.4 t/s are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request; the 72 GiB figure is artifact disk size, not measured resident memory.