Qwen3.8 27B
on NVIDIA RTX 4070 Ti Super · Ollama · 32,768 ctx
Use cases
tool-useagentic
Summary
User reports Qwen 3.8 27B at 36.5 t/s on an RTX 4070 Ti Super 16 GB with 64 GB system RAM.
Setup is Ollama on Windows with UD-Q3_K_XL and an 8-bit KV cache at 32K context.
The user says the 8-bit cache alone added about 26% generation speed and Q3+Q8 was about 78% faster than IQ4+Q8; other rows were Q4_K_M at 11.3 t/s, IQ4_XS at 16.3 t/s and IQ4_XS with 8-bit cache at 20.5 t/s. These are short tests on two warmed deterministic prompts, not an accuracy benchmark, and harder-task quality is untested.