llamaperf

Qwen3.6 35B (3B active)

on AMD Strix Halo 128GB · llama.cpp build 1 / a66d5058 / ROCm

AMD hardware
Oct 14, 2026
Throughput
60.0 t/s gen · 960.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
F16
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Qwen3.6-35B-A3B Q4_K_M at 60 t/s generation and 960 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama.cpp build a66d50588b105ef81fe6c2debd19440f5a8ab97a on ROCm with f16/f16 KV cache at depth 1024, one Radeon 8060S GPU, 8 threads, batch 1024 and microbatch 512. The headline figures are separate synthetic tests, PP512 and TG128, not one request; the exact values are 959.991546 t/s and 60.021451 t/s, each from a single repetition.