llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 3060 12GB · llama.cpp · 32,768 ctx

Tone: positiveNVIDIA hardware
May 9, 2026
Throughput
46.8 t/s gen · 914.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
Q8
Flash Attention
on
System RAM
32 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports llama-bench results of about 914 t/s for pp512 and about 46.8 t/s for tg128. A practical coding profile at 32k context generates at about 43.4 t/s. MTP gave about 47.7 t/s, a 2% improvement.