Qwen3.8 27B
on 2× NVIDIA RTX 3060 12GB · llama.cpp · 131,072 ctx
Sep 7, 2026
Use cases
codingagentic
Summary
User reports Qwen3.8-27B at 503.7 t/s prefill and 27.7 t/s decode on dual RTX 3060 12GB cards.
Setup is a Q4_K_M GGUF with a Q8_0 KV cache at 131k context, BF16 vision projector on CPU, xHigh reasoning, on a Ryzen 5 5500 with 64GB DDR4-3200 and GPUs limited to 130W each.
With speculation the user measured about 503 t/s prefill and about 29 t/s decode.