Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · llama.cpp
Summary
User reports Qwen3.8-Flash-Next at 4.4 t/s decode and ~2.9 t/s prefill on a RedMagic 10S Pro (Snapdragon 8 Elite, 24 GB RAM, 1 TB UFS).
Setup is llama.cpp with a 66 GB mixed-quant GGUF (2 shards), CPU only, no NPU or GPU path, pinned to one Oryon cluster with --cpu-mask 0x3f --cpu-strict 1 at -t 6. The weights are memory-mapped and demand-paged since they do not fit in RAM.
Speculative decoding with the MTP head was 4x slower (3.94 to 0.95 t/s) because the 2.8 GB sidecar pushed the expert working set past the page-cache cliff. Cluster pinning gave +26% and a NEON BF16 path gave +40% decode and +55% prefill. The user released the project as MonsterQwenDroid 0.1.0-alpha under MIT.