Qwen3.6 35B (3B active)
on Jetson AGX Orin 64GB · Strata
Summary
User reports roughly 40-41 tok/s decode on a Jetson AGX Orin 64GB running Qwen3.6-35B-A3B with sampled MTP-2 enabled, in a fork of Strata v0.1.45.
Setup uses unified INT8 KV caching, prefix checkpoints and optional KV preallocation. The user notes these were short-prompt tests and not matched llama.cpp-versus-Strata benchmarks.
For comparison, the user got around 21 tok/s decode with MTP-3 in llama.cpp and around 30 tok/s in earlier Strata runs.