llamaperf

Qwen3.6 35B (3B active)

on AMD RX 7800 XT 16GB · llama.cpp · 32,768 ctx

Tone: mixedAMD hardware
Oct 7, 2026
Throughput
110.0 t/s gen
Quant
UD-IQ3_XXS (GGUF)
KV cache
turbo4
VRAM reported
16 GB

Summary

User reports Qwen3.6-35B-A3B at ~110 t/s on an AMD RX 7800 XT 16GB with MTP and turbo4 KV cache at 32K context. Setup is a NJannasch llama.cpp mtp-turboquant fork on ROCm 6.4.0 (gfx1101) with UD-IQ3_XXS GGUF, turbo4 KV cache, --spec-type draft-mtp, and --reasoning-budget 512. MTP acceptance was 86% at 32K context; turbo4 KV saved ~470 MB vs f16 at 32K. The user warns that a silent CPU fallback can drop generation to 5-10 t/s and that gfx1032 cards crash with this fork.