Qwen3.8 27B
on NVIDIA RTX 3060 12GB · llama.cpp
Sep 22, 2026
Use cases
coding
Summary
User reports Qwen3.8 27B at ~29 t/s on an RTX 3060 12GB at around full context, with 34–40 t/s at lower context.
Setup is llama.cpp on CachyOS/Arch Linux with MTP/speculative decoding, comparing the ISTA-DASLab GSQ-RCO-IQ3-XXS quant (~10.4GB, ~2.5 BPW) against the ByteShape IQ3-XXS quant (~500MB smaller, 2.88 BPW).
The ByteShape quant performed worse in practice: the GSQ version generated a 3D voxel diorama in one shot under 55k tokens, while ByteShape took roughly three shots and still hadn't completed after over 98K tokens.