llamaperf

Qwen3.8 27B

on NVIDIA RTX 4060 Ti 16GB · llamADALL · 8,192 ctx

Tone: positiveNVIDIA hardware
Oct 6, 2026
Throughput
44.3 t/s gen · 870.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at 44.3 t/s generation and 870 t/s prompt processing on an RTX 4060 Ti 16GB, using a custom llama.cpp fork (llamADALL) built for 40-series cards. Setup uses MTP with 3 draft tokens, chat template and thinking on, power limited to 133 W, over a PCIe 1x to 16x mining riser. Numbers are the average of 2 runs on a chat growing from 8K to 124K tokens. The fork roughly doubles base llama.cpp speeds; at 124K context it reaches 33.0 t/s generation and 496 t/s prompt versus 16.6 and 193 for base llama.cpp. User notes removing the power limit improves results by 5-8%.