llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3060 12GB · llama.cpp · 50,000 ctx

Tone: mixedNVIDIA hardware
Sep 26, 2026
Quant
Q4_K_M (GGUF)

Use cases

agenticcoding

Summary

User reports running Qwen3.8-27B on a 2x3060 machine with llama.cpp, achieving generation speeds ranging from 43.37 to 49.99 t/s and prompt processing speeds from 45.01 to 198.10 t/s. Setup uses Q4_K_M quantization, 50000 context length, tensor split, flash attention, and speculative decoding with ngram-mod and draft-mtp. User notes the main limitation is short context, which is too short for long agentic sessions.