Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · libosmos
Summary
User reports libosmos v0.6.0 reaching up to 50 tok/s decode with MTP and about 950 tok/s prefill on Qwen3.8-Flash-Next at UD-IQ3_XXS.
Optimizations were made in a low power profile to focus on energy per token, with better kernels, fewer launches and less idle time between work.
The decode figure is given as a ceiling (up to 50 tok/s), and no GPU is named. DeepSeek numbers are unchanged and more SSD bound; a DeepSeek recipe at about 2.08 bpw is in progress.