Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · llama.cpp
Use cases
agentic
Summary
User reports Qwen3.8-Flash-Next UD-Q3_K_XL at 43.89 t/s prefill and 7.78 t/s generation on a CPU-only Intel Core Ultra 225 with 64 GB DDR5-6200.
Setup is llama.cpp with N-GRAM SSD offload, RAM pinning, IQ4 expert kernel, AVX2 hyperconnection fusion, and MTP with draft length 3.
Generation reached 11.30 t/s on Pi-Agent workloads; prefill improved from 23.61 to 43.89 t/s and generation from 5.42 to 7.78 t/s through the optimizations.