llamaperf

Qwen3.8 27B

on NVIDIA RTX 3060 12GB · llama.cpp

Tone: negativeNVIDIA hardware
Sep 22, 2026
Throughput
29.0 t/s gen
Quant
IQ3-XXS (GGUF)
MTP (Multi-Token Prediction)
on
System RAM
16 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at ~29 t/s on an RTX 3060 12GB at around full context, with 34–40 t/s at lower context. Setup is llama.cpp on CachyOS/Arch Linux with MTP/speculative decoding, comparing the ISTA-DASLab GSQ-RCO-IQ3-XXS quant (~10.4GB, ~2.5 BPW) against the ByteShape IQ3-XXS quant (~500MB smaller, 2.88 BPW). The ByteShape quant performed worse in practice: the GSQ version generated a 3D voxel diorama in one shot under 55k tokens, while ByteShape took roughly three shots and still hadn't completed after over 98K tokens.