Qwen3.8 27B
2× NVIDIA RTX A3000 Laptop 12GB · 163,000 ctx
- generation:
- 20.0 tokens/s
- prompt processing (prefill):
- 450.0 tokens/s
- quant:
- IQ3_S (GGUF)
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.
User reports Qwen3.8 27B at 20 t/s generation and 440-460 t/s prompt processing at 163k context. Setup runs on an RTX A3000M 12GB plus an RTX A2000M 8GB with P2P inside a NAS, using the GSQ-RCO IQ3_S quant. Prompt processing is given as a range of 460-440 t/s.