llamaperf
Nov 7, 2026
Throughput
70-80 t/s gen
System RAM
128 GB

Use cases

coding

Summary

User asks how fast Qwen3.8 Flash-Next runs on a Bosgame M5 128GB Strix Halo, with Gufo or Strata, and which quant to use. No hardware was run and no engine or quant is settled; the user is considering the machine. The only figure is secondhand, 70-80 t/s that others mention, and the user asks whether that holds in everyday coding use.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the AMD Strix Halo 128GB

Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the AMD Strix Halo 128GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →