Qwen3.8 27B
on 2× NVIDIA RTX 3060 12GB · llama.cpp · 50,000 ctx
Sep 26, 2026
Use cases
agenticcoding
Summary
User reports running Qwen3.8-27B on a 2x3060 machine with llama.cpp, achieving generation speeds ranging from 43.37 to 49.99 t/s and prompt processing speeds from 45.01 to 198.10 t/s.
Setup uses Q4_K_M quantization, 50000 context length, tensor split, flash attention, and speculative decoding with ngram-mod and draft-mtp.
User notes the main limitation is short context, which is too short for long agentic sessions.