llamaperf

Qwen3.8 27B

on NVIDIA RTX 4060 Ti 16GB · 98,000 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
20.0 t/s gen · 800.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_K_XXS
KV cache
Q8
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen 3.8 27B IQ3_K_XXS by Unsloth running fully on a 4060Ti 16GB at ~100k context, averaging 800 t/s prefill and 20 t/s decode. Setup uses a Q8 KV cache with mmproj and MTP dropped. Decode falls to 17 t/s after 64k context. The user runs agentic coding with parallel tool calls and successfully merged a feature branch, and plans to upgrade to an R9700.