Qwen3.8 27B
on 2× NVIDIA RTX A3000 Laptop 12GB · 163,000 ctx
Summary
User reports Qwen3.8 27B at 20 t/s generation and 440-460 t/s prompt processing at 163k context.
Setup runs on an RTX A3000M 12GB plus an RTX A2000M 8GB with P2P inside a NAS, using the GSQ-RCO IQ3_S quant.
Prompt processing is given as a range of 460-440 t/s.