llamaperf

Qwen3.6 27B-MTP / Vulkan native PP2048 TG128, MTP off

on AMD Strix Halo 128GB · rocmfp4-llama / Vulkan (mtp-rocmfp4-strix)

AMD hardware
Oct 13, 2026
Throughput
13.8 t/s gen · 294.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
ROCmFP4 STRIX hybrid embF16/headQ6 (GGUF)
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Qwen3.6 at 13.8 t/s generation and 294 t/s prompt processing on an AMD Strix Halo 128GB rig. Setup is the charlie12345/rocmfp4-llama fork with the ROCmFP4 STRIX hybrid embF16/headQ6 quant, run through native llama-bench with -ngl 999 -fa 1 -ub 1024 -r 3 and no MTP. The 13.8 t/s is the Vulkan0 TG128 figure and 294 t/s the Vulkan0 PP2048 figure, separate synthetic tests rather than one request; batch size, KV types, context depth and resident memory are unpublished.