llamaperf

Qwen3.8 27B

on NVIDIA RTX 4060 Ti 16GB · llama.cpp · 128,000 ctx

Tone: mixedNVIDIA hardware
Sep 7, 2026
Throughput
11.0 t/s gen
Quant
IQ3_S (GGUF)
KV cache
Q8
System RAM
32 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 27B IQ3_S at about 11 t/s for code generation and 6-7 t/s on reasoning. Setup is speculative decoding with a Q4_K_M draft model. User asks for optimization advice.