Qwen3.6 35B (3B active)
on AMD BC-250 16GB · QuarkStar · 2,048 ctx
Summary
User reports Qwen3.6-35B-A3B at 81.85 t/s generation and 639.85 t/s prefill on an AMD BC-250 16GB at 2K context.
Setup is QuarkStar, a new Vulkan/Metal inference engine, with Q2 quantization and fully resident inference on 16 GB.
User also reports M2 Pro 16GB results: 37.78 t/s generation and 448.75 t/s prefill at 2K, 31.08 t/s and 270.02 t/s at 8K, and 25.64 t/s and 177.21 t/s at 16K. The engine also supports KAT-Coder-V2.5-Dev and bounded SSD expert streaming for smaller machines.