Qwen3.6 35B (3B active)

User compares ninfer-3090 against llama.cpp on an RTX 3090 for Qwen3.6-35B-A3B and Qwen3.8-27B. The primary record is Qwen3.6-35B-A3B with ninfer-3090. llama.cpp with the UD-IQ4_XS GGUF reached 2439.7 t/s prefill, 148.6 t/s generation and 3410 ms TTFT. For Qwen3.8-27B, ninfer reached 187911.6 t/s prefill, 34.9 t/s generation and 27 ms TTFT, while llama.cpp reached 1012.7 t/s prefill, 38.5 t/s generation and 8160 ms TTFT. The benchmark used 7 prompts (4 long at roughly 7.7k-12.9k tokens, 1 medium at roughly 2.3k, 2 short at roughly 400-600), 3 repeats each, max_tokens=1024, seed=42 and cache busting via nonce. The ninfer-3090 system is a Ryzen 5 2600 with 16 GB RAM; the llama.cpp system is a Threadripper PRO 3945WX with 128 GB RAM. The user notes the hardware is not apples-to-apples but that inference is GPU-contained.