llamaperf

Qwen3.6 35B (3B active)

on AMD Strix Halo 128GB · llama.cpp · 524,288 ctx

Tone: positiveAMD hardware
Oct 9, 2026
Throughput
24.1 t/s gen · 322.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q8_K_XL (GGUF)
KV cache
q8_0
System RAM
128 GB

Use cases

long-contextcodingagentic

Summary

User reports Qwen3.6-35B-A3B at around 25 tok/s on a Strix Halo 128GB box (Minisforum MS-S1 MAX, Ryzen AI Max+ 395). Setup is llama.cpp b8890 with UD-Q8_K_XL GGUF and q8_0 KV cache, Vulkan RADV backend, 524288 context, 3 parallel slots, running under 100W. Live llama.cpp metrics at capture: 153562 tokens max context, 322.685 prompt tokens/s, 24.0673 predicted tokens/s. User notes long context needs architecture, quant, KV cache and backend to line up, and plans to test UD-Q3_K_XL next.