llamaperf

Qwen3.8 27B

on NVIDIA RTX 4070 Ti Super · llama.cpp

NVIDIA hardware
Sep 18, 2026
Throughput
10.0 t/s gen
Quant
Q5 (GGUF)
System RAM
256 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8 27B at around 10 t/s on an RTX 4070 Ti Super in a Threadripper 3975WX system with 256 GB RAM. Setup is llama.cpp server with the Unsloth Q5 GGUF, run with only --ctx-size and --jinja flags. User asks whether 10 t/s is the best achievable at this quant without a better GPU.