Qwen3.8 27B Uncensored
on 2× NVIDIA RTX 3060 12GB · Ollama · 68,115 ctx
Summary
User reports Qwen3.8-27B Uncensored at 17.89 t/s generation and 230.07 t/s prompt eval on a two-card rig of RTX 3060 plus RTX 2070 (about 20GB VRAM total).
Setup is Ollama in Docker with Q4_K_M GGUF, q8_0 KV cache, flash attention on, 68115-token context and all 65/65 layers on the GPUs; the host is an i5-13600 with 48GB DDR4.
The prompt eval figure is sustained over a 29,396-token run lasting 27m23s, with 19,489 MiB of VRAM in use.