Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · llama.cpp
Summary
User reports 6-7 t/s on Qwen 3.8 flash next with a 1-bit quant, running llama.cpp on 6 GB VRAM and 16 GB system RAM.
User calls the result fire for a 1-bit quant.
on Unknown GPU · llama.cpp