Qwen3.8 27B
on Unknown GPU · 8,192 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at around 2 t/s on a local setup with 4 GB VRAM and 32 GB system RAM at an 8k context window.
The model is offloaded to system RAM, which the user says makes generation barely usable.
The user asks whether renting cloud GPUs with ~48 GB VRAM for $0.20–$0.30/hr and deploying Ollama or vLLM in Docker is a practical alternative for ad-hoc study.