llamaperf

Qwen3.6 27B

on AMD Strix Halo 128GB · llama.cpp · 128,000 ctx

Tone: mixedAMD hardware
May 17, 2026
Quant
Q8_0 (GGUF)
Flash Attention
on
System RAM
30 GB

Use cases

long-context

Summary

User benchmarks MTP against non-MTP for 27B and 35B-A3B models. The 27B-MTP run shows significant speedup in generation and overall wall time for long-context chat. The 35B-MTP run shows mixed results: faster generation but slower end-to-end due to prefill overhead.