llamaperf

Qwen3.6 35B (3B active)

on AMD Radeon AI PRO R9700 32GB · llama.cpp · 262,144 ctx

AMD hardware
Aug 28, 2026
Throughput
84.5 t/s gen · 2000.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q5_K_M (GGUF)
KV cache
Q8
System RAM
64 GB
VRAM reported
32 GB

Use cases

codingtool-useagentic

Summary

User reports Qwen3.6-35B-A3B at 84.48 tokens per second generation and 2000.37 tokens per second prompt eval on a Radeon 9700 with 32GB VRAM. Setup is llama.cpp on Vulkan with the UD-Q5_K_M GGUF, -ngl 99, 262144 context, q8_0 KV cache, flash attention on, batch and ubatch size 2048, 8 threads and parallel 1. With MTP, which the user is now testing, generation is around 110 - 130 t/s and prefill drops to 1700 t/s. ROCm gave much faster prefill but slower generation.