gpt-oss 117B (5.1B active)
on NVIDIA DGX Spark · llama.cpp
Summary
User reports 52.87 t/s generation and 1689.47 t/s prompt processing.
Source evidence (verbatim):
Source: https://jetsonhacks.com/wp-content/uploads/2025/10/spark-llamacpp-bench.html
# llama.cpp on NVIDIA DGX Spark - Benchmarks
Benchmarks generated with llama.cpp tools on an NVIDIA DGX Spark (NVIDIA GB10, compute capability 12.1, VMM: yes). llama.cpp build b6767 (commit 5acd45546), improved decode via PR 16585. Settings: llama-bench with -fa 1, -p 2048, -n 32, -ub 2048, at context depths of 0, 4096, 8192, 16384 and 32768. All values are tokens per second. Model gpt-oss-120b MXFP4 MoE, 59.02 GiB, 116.83B params. At depth 0: pp2048 1689.47 t/s (+/- 107.67), tg32 52.87 t/s (+/- 1.70). At depth 4096: pp2048 1733.41, tg32 51.02. At depth 8192: pp2048 1705.93, tg32 48.46. At depth 16384: pp2048 1514.78, tg32 44.78. At depth 32768: pp2048 1221.23, tg32 38.76. Single stream llama-bench, no speculative decoding.