Qwen3.8 27B
on NVIDIA RTX 3090 · 65,536 ctx
Use cases
agentictool-uselong-context
Summary
User reports Qwen3.8 27B at ~35 tok/s on an RTX 3090 with 64K context and Q5 quant, used as an always-on personal assistant via Vercel's eve framework.
Setup is 64K context, Q5 quant, xhigh reasoning, single RTX 3090.
User notes quality is great but speed feels slow for live chat; tried Gemma MoE at 120 tok/s but found it unreliable. Plans to test Q4 and lower reasoning, and recently learned reasoning can be disabled for compaction.