llamaperf

Qwen3.8 27B

on AMD Strix Halo 128GB · llama.cpp · 142,000 ctx

Tone: positiveAMD hardware
Sep 7, 2026
Throughput
16-19 t/s gen
Quant
Q8_0 (GGUF)
KV cache
Q8
System RAM
128 GB
VRAM reported
64 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B Q8_0 on a Ryzen AI Max+ 395 in a ROG Flow Z13 with 128 GB unified memory, generating at 9-19 t/s and sustaining 16-19 t/s. Setup is Lemonade Server with llama.cpp ROCm, a Q8 KV cache, native MTP speculative decoding, a 64 GB VRAM and 64 GB RAM split, and roughly 142k context. MTP acceptance runs 97-99%. The model generated a flight simulator through an agent with file and bash tools.