- generation:
- 10.0 tokens/s
- quant:
- IQ3_XXS (GGUF)
User reports Qwen3.8 27B at IQ3_XXS averaging around 10 t/s on an RX 6700 XT 12GB, with 32GB DDR4 3200 and a Ryzen 5 5600X. No engine or context length is stated for the run. The user says the MoE model they also run gets 35 t/s or more, and is weighing the DeepSeek harness against pi dev and opencode for finding a useful local workload.