Qwen3.8 27B
on NVIDIA RTX 3060 12GB · llama.cpp · 98,304 ctx
Sep 27, 2026
Use cases
agenticcoding
Summary
User reports Qwen3.8-27B at ~9.7 tok/s generation and ~225 tok/s prompt processing on a single RTX 3060 12GB.
Setup is llama.cpp with Q4_K_S weights and Q4_0 KV cache at 96K context, using MTP speculative decoding with 46 FFN layers offloaded to system RAM.
MTP acceptance was ~88% with 2.76 mean accepted tokens; peak generation reached ~10.6 tok/s and VRAM usage was ~11.04 GB.