Qwen3.8 27B
on NVIDIA RTX 3060 12GB · llama.cpp · 65,536 ctx
Sep 27, 2026
Use cases
coding
Summary
User reports Qwen3.8-27B at 29.65-29.69 generated tokens/s on one RTX 3060 12 GB, with a 33.21 tokens/s high-acceptance peak.
Setup is llama.cpp with IQ3_XXS GGUF, Q4_0 KV cache, 65,536-token context, MTP depth 6, and Deferred-Commit Factor Replay.
A separate prefill sweep improved an 8,595-token prompt from 82.13 to 320.24 prompt tokens/s. Q4 at 32K measured 16.06 tok/s on a Rust task and 14.30 tok/s on a C++ task; Q3 at 96K and 128K measured 21.3-22.0 and 19.7-20.9 tok/s respectively.