Qwen3.8 27B
on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp · 255,000 ctx
Sep 7, 2026
Summary
User reports Qwen3.8 27B at 51.56 tokens per second over 5369 generated tokens with MTP on 2x R9700, writing a binary tree in javascript.
Setup is llama.cpp built in the ROCm 10 docker image with unsloth's Q8_K_XL GGUF, tensor split across both cards, 255000 context, f16 KV cache and MTP drafting up to 3 tokens, using 27GB on each card.
Draft acceptance is 0.72147. The user sees 37-50 tg/s generating text, spiking over 60tg/s when writing code.