llamaperf

Qwen3.8 27B

on NVIDIA RTX 3060 12GB · llama.cpp · 122,000 ctx

Tone: positiveNVIDIA hardware
Sep 20, 2026
Throughput
29.0 t/s gen
Quant
IQ3_XXS (GGUF)
System RAM
16 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports Qwen3.8 27B GSQ-RCO-IQ3-XXS at 29 t/s on an RTX 3060 12GB at full context, and 40 t/s at near-empty context. Setup is llama.cpp with MTP speculative decoding and high thinking enabled, using a 122K context window. The run used roughly 75K tokens and the context was compacted twice; the user rates this as the most impressive local model in a nine-model web-dev comparison.