Qwen3.5 35B (3B active)
on AMD Strix Halo 128GB · llama.cpp · 131,072 ctx
Summary
User reports Qwen3.5-35B-A3B at ~45 t/s single user on a Strix Halo (Radeon 8060S, gfx1151) with 90112 MiB unified memory visible to the GPU.
Setup is llama.cpp HIP build (commit 4d99d45) with Q4_K_M GGUF, 131072 context, -ngl 999, flash attention on, and -dio, running in a Proxmox LXC with ROCm 7.2.0.
Aggregate throughput reaches ~168 t/s at 16 parallel slots, where the user notes memory bandwidth becomes the limit.