llamaperf

Laguna S 2.1 118B

on AMD Strix Halo 128GB · Gufo

Tone: positiveAMD hardware
Nov 1, 2026
Throughput
25.9 t/s gen · 1277.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
System RAM
128 GB

Summary

User reports Laguna S 2.1, a ~118B MoE with 256 experts (10 routed plus 1 shared), running end to end on a Strix Halo / Ryzen AI MAX+ 395 with a gufo fork using the NPU alongside the GPU. Decode is 25.9 tok/s plain and prefill reaches up to 1,277 tok/s with the NPU helping, versus ~1,145 tok/s GPU-only. Setup is the gufo engine with NPU+GPU offload; quant and context length are not stated. With the DFlash v1 drafter decode rises to 44-45 tok/s on code and JSON, while prose is more like 28 tok/s, as acceptance depends on content type.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Models most run on the AMD Strix Halo 128GB

Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the AMD Strix Halo 128GB →Every Laguna S 2.1 report →Estimate Laguna S 2.1 on this card →