llamaperf
Oct 3, 2026
Throughput
30.0 t/s gen
Quant
Q4
System RAM
128 GB

Use cases

coding

Summary

User reports Qwen3.8-27B at around 30 t/s on a Bosgame M5 with Ryzen AI Max+ 395 and 128 GB, used for coding. Setup is a Q4 quant; the user also runs Gemma4 26B A4B at around 90 t/s for other tasks. The user asks whether switching to Qwen3.8-Flash-Next is worth it, noting a 4-bit quant of it is around 90 GB and would require dropping the second model.