Qwen3.6 27B
on 2× NVIDIA RTX 3090 · llama.cpp · 262,144 ctx
Use cases
coding
Summary
User reports Qwen3.6-27B-MTP UD-Q8_K_XL running on 2x RTX 3090 with llama.cpp build b9455, using tensor-split 50,50 and MTP speculative decoding. Decode speeds range from 54 to 81 t/s across runs, with prefill between 823 and 1421 t/s at contexts up to 68K. The user notes vLLM previously achieved 70+ t/s but lacked good quants, and praises the code output quality with this setup.