Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · llama.cpp
Summary
User benchmarks Qwen3.8-Flash-Next at a 3-bit quant on an AMD EPYC 7532 with 128 GB DDR4-3200 in eight channels, CPU only, reaching 8.33 tok/s at 32 threads.
Setup is llama.cpp with the roughly 180B-parameter mixture (about 6B active per token) held entirely in system RAM, beside the machine's normal services.
The same model ran 6.51 tok/s at 8 threads and 7.74 tok/s at 16 threads. The post also reports other models on three more machines, including gemma4:26b at 12.66 to 24.68 tok/s and llama3.3:70b at 2.70 tok/s on the EPYC.