Qwen3.6 35B (3B active)
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.6 35B-A3B at 49.1 t/s generation and 1028.1 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with UD-Q4_K_XL, f16 key/value cache and FlashAttention on, measured at a depth of 16,384 already-prefilled KV tokens.
These are separate llama-bench pp512 and tg128 tests, not a fresh 16,384-token ingest; the same ladder gives 52.73 t/s generation at depth 0 and 50.95 t/s at depth 8,192.