Qwen3.8 27B
on NVIDIA RTX 3060 12GB · llama.cpp · 122,000 ctx
Sep 20, 2026
Use cases
coding
Summary
User reports Qwen3.8 27B GSQ-RCO-IQ3-XXS at 29 t/s on an RTX 3060 12GB at full context, and 40 t/s at near-empty context.
Setup is llama.cpp with MTP speculative decoding and high thinking enabled, using a 122K context window.
The run used roughly 75K tokens and the context was compacted twice; the user rates this as the most impressive local model in a nine-model web-dev comparison.