Qwen3.8 27B
on 2× NVIDIA RTX 3080 20GB · 210,000 ctx
Use cases
codingagenticlong-context
Summary
User reports running Qwen3.8 27B Q6 with 210k context on two modded 20GB RTX 3080s, generating at ~45 t/s with prefill at ~500 t/s.
The 40GB of VRAM was filled by the model and context; the build cost $2250 plus $250 for an extra 64GB of RAM, and has run for 6 weeks.
Both throughput figures are approximate single readings. The user's goal is a local coding agent with long full-precision contexts and several agents at once.