llamaperf

Qwen3.6 35B (3B active)

on AMD RX 7900 XTX · llama.cpp

AMD hardware
Oct 24, 2026
Throughput
125.5 t/s gen · 1874.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
VRAM reported
24 GB

Summary

User reports Qwen3.6-35B-A3B at 125.47 t/s generation on an RX 7900 XTX 24GB. Setup is llama.cpp (Vulkan backend, v0.7.0) via LM Studio with Q4_K_M GGUF and no speculative decoding. Three consecutive runs gave 125.47, 125.07 and 126.47 t/s generation; prompt processing was 1874.71 t/s over 427 tokens, 1288.99 t/s over 311 tokens and 770.07 t/s over 157 tokens.