llamaperf

Qwen3.8 27B

on AMD RX 9070 XT 16GB · llama.cpp

AMD hardware
Oct 31, 2026
Throughput
65.0 t/s gen
Quant
IQ3_M (GGUF)
System RAM
32 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8-27B at about 65 tok/s on a Radeon RX 9070 XT. Setup is llama.cpp with IQ3_M weights, run under both Vulkan and ROCm 10.1 on a Ryzen 7 7800X3D with 32 GB DDR5. User asks whether Strata can span two machines to run Qwen3.8-Flash-Next (125B-A6B), and whether llama.cpp RPC over a LAN is realistic; no figures are given for that setup.