llamaperf

Qwen3.8 27B pi

on 2× NVIDIA RTX 3060 12GB · llama.cpp · 75,776 ctx

Tone: positiveNVIDIA hardware
Oct 20, 2026
Throughput
30-40 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
q8_0/q4_0
System RAM
32 GB

Use cases

codingagentic

Summary

User reports running Qwen3.8-27B-pi at 30-40 tok/s generation on an RTX 3080 10GB plus RTX 3060 12GB, with 32GB DDR5 4800 system RAM. Setup is llama.cpp (llama-server) with Q4_K_M weights, q8_0 K cache and q4_0 V cache, 75776 context, layer split with tensor-split 107,93, and MTP draft speculation (draft model Q4_0 on CUDA1, spec-draft-n-max 3). Average MTP acceptance is about 0.75; pushing n-max above 3 causes OOM. User tried DFlash2 but found it slower than MTP, and is generally happy with quality and speed, having started at 10 tokens per second with Qwen 3.8.