Qwen3.8 27B
on NVIDIA RTX 3090 · vLLM
Sep 13, 2026
Use cases
codingtool-use
Summary
User reports Qwen3.8 27B at an average 100 t/s on an RTX 3090, compared to 20 t/s on a MacBook M5 Pro 48GB.
Setup is vLLM with a Q4 model on Linux, served over an OpenAI endpoint. The Mac run used llama.cpp with MTP and an Unsloth Q6 quant; Q4 on Mac made little speed difference.
User notes tool calls fail more often but the model self-corrects, and considers the setup good enough to replace a Claude subscription.