llamaperf

Qwen3.8 27B

on NVIDIA RTX 4070 Ti Super · Ollama · 32,768 ctx

Tone: positiveNVIDIA hardware
Oct 24, 2026
Throughput
36.5 t/s gen
Quant
UD-Q3_K_XL (GGUF)
KV cache
Q8
System RAM
64 GB
VRAM reported
16 GB

Use cases

tool-useagentic

Summary

User reports Qwen 3.8 27B at 36.5 t/s on an RTX 4070 Ti Super 16 GB with 64 GB system RAM. Setup is Ollama on Windows with UD-Q3_K_XL and an 8-bit KV cache at 32K context. The user says the 8-bit cache alone added about 26% generation speed and Q3+Q8 was about 78% faster than IQ4+Q8; other rows were Q4_K_M at 11.3 t/s, IQ4_XS at 16.3 t/s and IQ4_XS with 8-bit cache at 20.5 t/s. These are short tests on two warmed deterministic prompts, not an accuracy benchmark, and harder-task quality is untested.