llamaperf

gpt-oss 117B (5.1B active)

on AMD Strix Halo 128GB · llama.cpp b6451 / 360d6533 / Windows Vulkan

AMD hardware
Oct 14, 2026
Throughput
48.6 t/s gen · 732.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports gpt-oss 120B MXFP4 at 48.6 t/s generation and 732.7 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama.cpp build 6451 (360d6533) with the Vulkan backend, -ngl 999, flash attention enabled and -mmp 0, on a single Radeon 8060S iGPU with 128 GB unified memory. The stored figures are the FA1 comparison run's TG128 and PP512 phases, separate synthetic benchmarks rather than one request; the same run's FA0 comparison gave 49.65 t/s TG128 and 641.87 t/s PP512.