Qwen3.8 27B
on NVIDIA RTX 4060 Ti 16GB · llamADALL · 8,192 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at 44.3 t/s generation and 870 t/s prompt processing on an RTX 4060 Ti 16GB, using a custom llama.cpp fork (llamADALL) built for 40-series cards.
Setup uses MTP with 3 draft tokens, chat template and thinking on, power limited to 133 W, over a PCIe 1x to 16x mining riser. Numbers are the average of 2 runs on a chat growing from 8K to 124K tokens.
The fork roughly doubles base llama.cpp speeds; at 124K context it reaches 33.0 t/s generation and 496 t/s prompt versus 16.6 and 193 for base llama.cpp. User notes removing the power limit improves results by 5-8%.