Strata on the AMD Strix Halo 128GB
llamaperf has 3 Strata reports on the AMD Strix Halo 128GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.
3 Strata reports on the AMD Strix Halo 128GB
Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup.
- Qwen3.8 125B · 6B active · UD-IQ4_XS42.7 t/s(speculative decoding)
- Qwen3.8 125B · 6B active · UD-IQ4_XS42.0 t/s(speculative decoding)
- Qwen3.8 125B · 6B active · UD-IQ4_XS53.8 t/s
Frequently asked
How fast is Strata on the AMD Strix Halo 128GB?
llamaperf has 3 Strata reports on the AMD Strix Halo 128GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.