Qwen3.8 27B
on 2× NVIDIA RTX 3060 12GB · llama.cpp · 131,072 ctx
Sep 7, 2026
Use cases
coding
Summary
User reports about 40 t/s with a Q4_K_XL quant on 2x RTX 3060 12GB.
Setup is llama.cpp with flash attention and speculative decoding.
The model wrote CUDA code but could not run it due to VRAM limits.