llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3060 12GB · 100,000 ctx

Tone: positiveNVIDIA hardware
Sep 20, 2026
Throughput
45.0 t/s gen · 600.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4
KV cache
Q4
System RAM
128 GB
VRAM reported
24 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at 45 t/s generation and 600 t/s prompt processing on a dual RTX 3060 12GB setup. Setup uses a Q4 model and Q4 KV cache at roughly 100k context, with the model running fully on the GPUs. The user is asking for upgrade advice and considering a 4x RTX 3060 build or 24GB Intel cards, and wonders whether PCIe lanes would bottleneck a four-card setup.