Qwen3.8 27B

User compares local model choices by memory budget, recommending Qwen3.8-27B at Q4 for 32 GB or more of VRAM and Qwen3.8-Flash-Next on Strata otherwise. On 2x RTX 5070 Ti 16 GB with 96 GB RAM, the user measures Qwen3.8-27B under ninfer-tp2 with MTP/DFlash at roughly 180-290 t/s. Other reported figures include a single 5090 at about 150-210 t/s with MTP3 and 260-290 t/s on code with DFlash2, a single R9700 at about 50-65 t/s under llama.cpp or vLLM with MTP, and 2x R9700 at about 185 t/s under vLLM MXFP4 with speculative decoding. For Qwen3.8-Flash-Next on Strata the user measures 62-72 t/s decode on one GPU and 80-90 t/s on two, with prefill around 2,400 and 3,000 t/s at 16k.