Qwen3.8 27B
2× AMD RX 6800 16GB · llama.cpp · 131,072 ctx
- generation:
- 45.0 tokens/s
- quant:
- IQ4_XS
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is shown only when the source reports it; generation speed cannot tell us time to first token. Check the full setup before comparing.
User runs Qwen3.8 27B IQ4_XS at 131k context on two RTX 2060 12GB cards, 24 GB total, and gets about 45 t/s. Setup is llama.cpp. User asks whether an upgrade to an RX 6800 16GB plus an RX 6800 XT 16GB, 32 GB total, would improve performance and how ROCm and Vulkan support compare.