llamaperf

gpt-oss 117B (5.1B active)

on NVIDIA DGX Spark · llama.cpp

NVIDIA hardware
Oct 15, 2026
Throughput
52.9 t/s gen · 1689.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (MXFP4)

Summary

User reports 52.87 t/s generation and 1689.47 t/s prompt processing. Source evidence (verbatim): Source: https://jetsonhacks.com/wp-content/uploads/2025/10/spark-llamacpp-bench.html # llama.cpp on NVIDIA DGX Spark - Benchmarks Benchmarks generated with llama.cpp tools on an NVIDIA DGX Spark (NVIDIA GB10, compute capability 12.1, VMM: yes). llama.cpp build b6767 (commit 5acd45546), improved decode via PR 16585. Settings: llama-bench with -fa 1, -p 2048, -n 32, -ub 2048, at context depths of 0, 4096, 8192, 16384 and 32768. All values are tokens per second. Model gpt-oss-120b MXFP4 MoE, 59.02 GiB, 116.83B params. At depth 0: pp2048 1689.47 t/s (+/- 107.67), tg32 52.87 t/s (+/- 1.70). At depth 4096: pp2048 1733.41, tg32 51.02. At depth 8192: pp2048 1705.93, tg32 48.46. At depth 16384: pp2048 1514.78, tg32 44.78. At depth 32768: pp2048 1221.23, tg32 38.76. Single stream llama-bench, no speculative decoding.