llamaperf

Qwen3.6 35B (3B active)

on Jetson AGX Orin 64GB · Strata

Tone: positive
Oct 25, 2026
Throughput
40-41 t/s gen
KV cache
INT8
System RAM
64 GB

Summary

User reports roughly 40-41 tok/s decode on a Jetson AGX Orin 64GB running Qwen3.6-35B-A3B with sampled MTP-2 enabled, in a fork of Strata v0.1.45. Setup uses unified INT8 KV caching, prefix checkpoints and optional KV preallocation. The user notes these were short-prompt tests and not matched llama.cpp-versus-Strata benchmarks. For comparison, the user got around 21 tok/s decode with MTP-3 in llama.cpp and around 30 tok/s in earlier Strata runs.