llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · llama.cpp · 131,072 ctx

AMD hardware
Oct 1, 2026
Throughput
23.8 t/s gen
VRAM reported
24 GB

Summary

User reports Qwen3.8-27B at 23.8 tok/s decode on a single Radeon RX 7900 XTX 24 GB. Setup is a llama.cpp fork with a 131,072-token context and single stream (parallel 1), no speculation. With draft-mtp plus ngram-map-k speculation the same setup reaches 47.6 tok/s. The card runs a 272 W power cap (factory 303 W), a -75 mV undervolt and max SCLK 2200 MHz.