Qwen3.6 35B (3B active)
on AMD Strix Halo 128GB · llama.cpp · 524,288 ctx
Use cases
long-contextcodingagentic
Summary
User reports Qwen3.6-35B-A3B at around 25 tok/s on a Strix Halo 128GB box (Minisforum MS-S1 MAX, Ryzen AI Max+ 395).
Setup is llama.cpp b8890 with UD-Q8_K_XL GGUF and q8_0 KV cache, Vulkan RADV backend, 524288 context, 3 parallel slots, running under 100W.
Live llama.cpp metrics at capture: 153562 tokens max context, 322.685 prompt tokens/s, 24.0673 predicted tokens/s. User notes long context needs architecture, quant, KV cache and backend to line up, and plans to test UD-Q3_K_XL next.