llamaperf

gpt-oss 117B (5.1B active)

on AMD Gorgon Halo 192GB · llama.cpp · 512 ctx

Tone: positiveAMD hardware
Oct 12, 2026
Throughput
55.7 t/s gen · 1135.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (MXFP4)
System RAM
192 GB

Use cases

agenticcodinglong-context

Summary

User benchmarks gpt-oss 120B at 55.7 t/s generation and 1135 t/s prompt processing on a Minisforum MS-S1 MAX P495 (Ryzen AI Max+ PRO 495, Radeon 8065S, 192GB). Setup is llama.cpp build 23b0202a1 with Vulkan backend, MXFP4 quant, pp512 and tg128, all layers on GPU. At 32k context the model still reaches 42.3 t/s generation and 385 t/s prompt processing. Other models tested: Qwen3 Coder 30B A3B Q8_0 at 62.8 t/s, Qwen3.8 27B Q8_0 at 8.1 t/s, MiniMax M2.7 230B A10B UD IQ4_XS at 30.2 t/s, and DeepSeek V4 Flash 0731 284B A13B UD IQ3_S at 17.8 t/s. MiniMax crashed at 32k depth with default ubatch and required ubatch 256, which lowered prompt processing.