llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3080 20GB · llama.cpp · 131,100 ctx

Tone: mixedNVIDIA hardware
Oct 9, 2026
Throughput
21.0 t/s gen
Quant
Q8 (GGUF)
VRAM reported
20 GB

Use cases

codingvisionlong-context

Summary

User reports Qwen3.8-27B at about 21 t/s on two modded RTX 3080 20GB cards, with MTP raising it to 33 t/s. Setup is llama.cpp with Q8 weights and 131.1k context plus vision, run on the two 3080s; the 3080s are power limited to 220W. The user also ran Gemma 4-26B-A4B on a single RTX 4070 Ti 12GB and found coding output poor, and has just reinstalled the 4070 Ti so has limited data with all three cards.