Qwen3.5 35B (3B active)

User reports Qwen3.5-35B-A3B at ~980 t/s prompt processing and 75-80 t/s generation on a single RTX 3090 24GB. Setup is llama.cpp with the RPC backend, IQ4_NL GGUF, flash attention on, 64K context per agent, and all layers offloaded to the GPU. The host is an AMD EPYC 7663 with 128GB DDR4 RAM. Generation is given only as a 75-80 t/s range. Two instances run simultaneously (planner and coder).