llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3060 12GB · ExLlamaV3 · 170,000 ctx

NVIDIA hardware
Sep 26, 2026
Throughput
20-40 t/s gen
Quant
exl3-4.0bpw (EXL3)

Summary

User reports Qwen3.8-27B at 20-40 tokens per second on 2x RTX 3060 12GB. Setup is ExLlamaV3 with an exl3-4.0bpw quant at roughly 170k context. The user asks for tips to improve performance.