Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 5070 Ti · llama.cpp · 32,768 ctx
Oct 6, 2026
Summary
User reports Qwen3.8 Flash-Next 125B-A6B abliterated at around 28 t/s generation and 400-600 pp on an RTX 5070 Ti 16GB plus RTX A4000 16GB with 128GB system RAM.
Setup is stock llama.cpp with Q4 GGUF weights, q8_0 KV cache, 32768 context, 48 GPU layers, tensor-split 64,18 and ncmoe 35, so part of the model runs from system RAM.
User is happy with the speed but asks whether the Strata engine can use multiple GPUs and whether it would improve on the 60 t/s others report on 12GB laptops.