Use cases
coding
Summary
User reports Qwen3.8 27B at 100 t/s on a 4x RTX 3090 machine with 96GB VRAM and 384GB DDR4 RAM.
Setup uses DFlash2 speculative decoding with BF16 weights.
User also tested Qwen3.8 Flash-Next at 4-bit, getting about 70 t/s, and found it produced visual glitches and HTML issues compared to 27B. Tried Intel AutoRound W4A16, generic W4A16, and Unsloth UD-Q4_K_XL quants for Flash-Next.