Qwen3.8 27B

User reports Qwen3.8-27B at about 34 t/s per stream across four concurrent requests on an RTX 3090 Ti, roughly 135-160 t/s total. Setup is vLLM with 4-bit W4A16 weights fully in VRAM, 69.6k context, four requests batched at once; four 17.9k-token prompts read together gave first token after about 19 s (~3,700 t/s total). A CPU-only Qwen3.6-35B-A3B Q8 slot adds a fifth stream at ~9 t/s writing and 103 t/s reading on a 1.7k prompt (67 t/s at 12.8k). User compares this against Strata running Qwen3.8-Flash-Next 125B IQ3_S at 106-144 t/s writing and ~2,800 t/s reading, and Maya-M running GLM-5.3-Flash 321B at 18-24 t/s writing and ~500-1,150 t/s reading, both one request at a time. The main model, DeepSeek-V4.1-Flash at 2.77 bpw on 2x DGX Spark, writes ~40-55 t/s and reads ~1,600-2,000 t/s.