Qwen3.8 27B
on 2× NVIDIA RTX 5060 Ti 16GB · llama.cpp · 131,072 ctx
Use cases
creative-writing
Summary
User reports Qwen3.8 27B generating a GTA-style game, with prompt processing of ~850-890 t/s for 25k tokens and generation typically 50-55 t/s, peaking at 197 t/s with ngram speculative decoding.
Setup is llama.cpp with ngram and MTP draft, a Q8 KV cache, and 128k context.
User is enthusiastic about the results.