llamaperf

Qwen3.8 27B

on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown

AMD hardware
Oct 13, 2026
Throughput
7.5 t/s gen · 236.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Qwen3.8-27B at 7.5 t/s generation and 236.7 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory. Setup is llama.cpp with official Q8_0, full offload (ngl 999), batch 2048, flash attention and 32 threads. The figures are separate llama-bench pp512 and tg128 microbenchmarks, not one end-to-end request; the home narrative reports 7.53 t/s for the same run.