Qwen3.6 27B
on NVIDIA RTX 5060 Ti 16GB · Ollama · 100,000 ctx
Use cases
summarizationlong-context
Summary
User reports Qwen 27B Q4_K_M on Ollama at 100k context, running on an RTX 5060 Ti and 5070 Ti, with ~1050 t/s prompt processing and ~46 t/s generation on a ~35k token prompt.
Setup is Open WebUI with Open Terminal integration on Unraid, with inference on a separate machine.
The use case is legal document research and creation.