Laguna S 2.1 118B
on AMD Strix Halo 128GB · Gufo
Summary
User reports Laguna S 2.1, a ~118B MoE with 256 experts (10 routed plus 1 shared), running end to end on a Strix Halo / Ryzen AI MAX+ 395 with a gufo fork using the NPU alongside the GPU. Decode is 25.9 tok/s plain and prefill reaches up to 1,277 tok/s with the NPU helping, versus ~1,145 tok/s GPU-only.
Setup is the gufo engine with NPU+GPU offload; quant and context length are not stated.
With the DFlash v1 drafter decode rises to 44-45 tok/s on code and JSON, while prose is more like 28 tok/s, as acceptance depends on content type.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Models most run on the AMD Strix Halo 128GB
- 26.6 t/s · 8 runs
- 60.0 t/s · 7 runs
- 69.9 t/s · 6 runs
- 50.4 t/s · 4 runs
- 52.6 t/s · 4 runs
- 71.7 t/s · 4 runs
Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD Strix Halo 128GB →Every Laguna S 2.1 report →Estimate Laguna S 2.1 on this card →