Qwen3.6 27B
on NVIDIA RTX 4090 · LM Studio · 120,000 ctx
Use cases
coding
Summary
User reports 3000 tokens in about 2 minutes, or 25 t/s, and is seeking faster performance.
Setup is Q4_0 with 120k context and both caches quantized to 4_0.
A reply adds a vLLM benchmark on an RTX 3090: a 27B INT4 quant at 125K context with a TurboQuant 3-bit NC KV cache and MTP speculative decoding, reaching 82 tok/s generation and 0.3-0.6s TTFT.