Qwen3.8 27B
on 3× NVIDIA RTX 3060 12GB · llama.cpp
Sep 25, 2026
Summary
User reports Qwen3.8 27B at 25 t/s on three RTX 3060 12GB cards.
Setup is llama.cpp in layered mode with a Q6 quant.
The figure is a current baseline; the user asks whether moving to four or eight RTX 3060s under vLLM would improve or hurt token generation.