Qwen3.6 35B (3B active)
on AMD Strix Halo 128GB · llama.cpp build 1 / a66d5058 / ROCm
Summary
User reports Qwen3.6-35B-A3B Q4_K_M at 60 t/s generation and 960 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp build a66d50588b105ef81fe6c2debd19440f5a8ab97a on ROCm with f16/f16 KV cache at depth 1024, one Radeon 8060S GPU, 8 threads, batch 1024 and microbatch 512.
The headline figures are separate synthetic tests, PP512 and TG128, not one request; the exact values are 959.991546 t/s and 60.021451 t/s, each from a single repetition.