llamaperf

Qwen3.6 35B (3B active)

on AMD Strix Halo 128GB · llama.cpp b9747 / d6d89958 / Vulkan RADV

AMD hardware
Oct 14, 2026
Throughput
73.4 t/s gen · 1094.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
F16
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Qwen3.6-35B-A3B at 73.4 t/s generation and 1094.5 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama.cpp build 9747 with Vulkan RADV, Q4_K_M quantization and f16/f16 KV cache at depth 1024, one Radeon 8060S GPU. The headline figures are separate synthetic PP512 and TG128 tests, not one request; generation falls to 58.824494 t/s at depth 32768 with the same KV type.