llamaperf

Qwen3.6 27B

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp · 131,072 ctx

AMD hardware
Aug 28, 2026
Quant
Q8_0 (GGUF)
KV cache
F16
Flash Attention
on
MTP (Multi-Token Prediction)
on
System RAM
128 GB
VRAM reported
64 GB

Use cases

codingsummarizationlong-context

Summary

User reports 40-67 t/s decode on 2x Radeon AI PRO R9700 32GB at 131,072 context. Setup uses an F16 KV cache. Prefill throughput is 410-1500 t/s. MTP draft acceptance ranges from 0.33-0.61.