Qwen3.5 2B
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.5 2B at 67.7 t/s generation and 2886 t/s prompt processing on an AMD Strix Halo 128GB box with a Radeon 8060S.
Setup is llama.cpp on the rdna35-perf branch with Q8_0 weights, q8_0 KV cache, Flash Attention on and microbatch 2048, measured with llama-bench.
The two figures are separate benchmark cells at a source-labeled 128k tokens already in the KV cache, not one end-to-end request; the prompt test processes 2048 additional tokens at that depth and is not TTFT.