Qwen3.6 35B (3B active)

User reports Qwen3.6-35B-A3B at 11.7 tok/s warm cache on a Radxa ROCK 5C (Rockchip RK3588S) with 8 GB RAM, CPU only on 4x Cortex-A76. Setup uses a custom ~2-bit quantization and a custom inference engine, with the model stored on a microSD; the 11.0 GB on-disk model exceeds RAM so part is streamed from storage. Typical chat on new topics runs 5~8 tok/s and cold start about 2 tok/s. Quality versus the original BF16 model: MMLU 76.0% vs 84.2%, ARC-Challenge 94.1% vs 95.0%, with MMLU noted as a 10-per-subject subset carrying about ±3.5 points of noise.