llamaperf

Qwen3.6 35B (3B active)

on AMD BC-250 16GB · QuarkStar · 2,048 ctx

Tone: positive
Oct 9, 2026
Throughput
81.8 t/s gen · 639.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q2
VRAM reported
16 GB

Summary

User reports Qwen3.6-35B-A3B at 81.85 t/s generation and 639.85 t/s prefill on an AMD BC-250 16GB at 2K context. Setup is QuarkStar, a new Vulkan/Metal inference engine, with Q2 quantization and fully resident inference on 16 GB. User also reports M2 Pro 16GB results: 37.78 t/s generation and 448.75 t/s prefill at 2K, 31.08 t/s and 270.02 t/s at 8K, and 25.64 t/s and 177.21 t/s at 16K. The engine also supports KAT-Coder-V2.5-Dev and bounded SSD expert streaming for smaller machines.