llamaperf

Qwen3.8 27B

on AMD Strix Halo 128GB · paoai-strix-engine · 8,192 ctx

Tone: positiveAMD hardware
Oct 9, 2026
Throughput
42.4 t/s gen · 404.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
ROCmFP4 (GGUF)
System RAM
128 GB

Use cases

codinglong-context

Summary

User reports Qwen3.8-27B at 42.4 t/s writing code on one Strix Halo 128GB, with 404 t/s prompt reading at 8K context. Setup is the paoai-strix-engine strix-v4 Vulkan build with a 15 GB ROCmFP4 GGUF, MTP draft head for the Chat profile, DFlash2 adaptive drafting for Code and Long, and an f16 KV cache for Long. Three serving profiles were measured at 8K, 32K, 64K, 128K and 256K with fresh prompts and prompt cache off; the 256K window was verified on all three, and the Code and Long profiles scored 100 on a coding exam. A 55-task quality bench scored 83.2 for Chat.