llamaperf

Qwen3.6 35B (3B active)

on AMD Radeon AI PRO R9700 32GB · vLLM · 262,144 ctx

Tone: positiveAMD hardware
Sep 7, 2026
Throughput
61.4 t/s gen · 7800.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
INT4 (W4A16)
KV cache
FP8
VRAM reported
32 GB

Summary

User benchmarks Qwen3.6 35B-A3B MoE on a single R9700 with vLLM, using INT4 weights from Avesed. The user also tests a 27B dense model with MTP spec=4. Prefill and decode speeds are measured at various context depths, and the user is happy with the results.