llamaperf

Qwen3.6 27B

on 2× NVIDIA RTX 3090 · llama.cpp · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 27, 2026
Quant
UD-Q8_K_XL (GGUF)
KV cache
q8_0
Flash Attention
on

Use cases

coding

Summary

User reports Qwen3.6-27B-MTP UD-Q8_K_XL running on 2x RTX 3090 with llama.cpp build b9455, using tensor-split 50,50 and MTP speculative decoding. Decode speeds range from 54 to 81 t/s across runs, with prefill between 823 and 1421 t/s at contexts up to 68K. The user notes vLLM previously achieved 70+ t/s but lacked good quants, and praises the code output quality with this setup.