Qwen3.6 27B

User benchmarks Qwen3.6 27B Q5_K_M on dual AMD Radeon AI PRO R9700 GPUs, reporting 24.85 t/s generation and 611.02 t/s prompt processing at 32768 context on a single GPU. Setup is llama.cpp with ROCm, Q5_K_M GGUF weights, q8_0 KV cache, flash attention, and 2 GPUs with layer split. Dual GPUs roughly doubled long-context prefill (1215.87 t/s at 32768) but did not improve single-stream generation (24.31 t/s). The user also tested Gemma 4 31B, Qwen3.6 35B A3B, and Gemma 4 26B A4B, finding sparse-active models much faster but not directly comparable to dense models.