llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3060 12GB · llama.cpp · 131,072 ctx

NVIDIA hardware
Oct 5, 2026
Throughput
47.3 t/s gen
Quant
Q4_K_XL (GGUF)
System RAM
64 GB

Summary

User reports Qwen3.8-27B at 47.3 tok/s decode on 2x RTX 3060 12GB. Setup is llama.cpp (server-cuda12-b11146) with UD-Q4_K_XL GGUF, tensor split, auto-fit and the GGUF's built-in MTP head, at 131,072 tokens of context. TTFT 537 ms. The same PR also validates 20 single-card RTX 3060 12GB recipes and adds a second two-card recipe, Qwen3.6-35B-A3B at 74.2 tok/s decode and 147 ms TTFT at 131,072 tokens. Long-context recall was tested at 104,941 tokens. Several candidates failed (missing quant tag pulling default Q4_K_M, empty model path, OOM) and 16 were skipped for 512-2,048-token contexts.