llamaperf

Qwen3.5 35B (3B active)

on AMD Strix Halo 128GB · llama.cpp · 131,072 ctx

AMD hardware
Oct 6, 2026
Throughput
45.0 t/s gen
Quant
Q4_K_M (GGUF)
VRAM reported
90112 GB

Summary

User reports Qwen3.5-35B-A3B at ~45 t/s single user on a Strix Halo (Radeon 8060S, gfx1151) with 90112 MiB unified memory visible to the GPU. Setup is llama.cpp HIP build (commit 4d99d45) with Q4_K_M GGUF, 131072 context, -ngl 999, flash attention on, and -dio, running in a Proxmox LXC with ROCm 7.2.0. Aggregate throughput reaches ~168 t/s at 16 parallel slots, where the user notes memory bandwidth becomes the limit.