Qwen3.5 35B (3B active)

User reports Qwen3.5-35B-A3B at 31.4 tok/s decode and 2001 tok/s prefill on a Jetson AGX Orin 64GB. Setup is vLLM 0.17.0 with a pre-built SM 8.7 wheel enabling Marlin GPTQ tensor core kernels, GPTQ-Int4 weights, 4096 context, single sequence. Decode holds 30.9 tok/s at ~4,000 tokens and 29.2 tok/s at ~20,000 tokens. Compared against llama.cpp Q4_K_M at 22.5 tok/s decode and 523 tok/s prefill, and vLLM GPTQ without Marlin at 241 tok/s prefill. End-to-end 20k context plus 200 output tokens takes 17s versus 47s on llama.cpp.