Qwen3.6 35B (3B active)
on RTX 3070 Laptop 8GB · Krasis
Summary
User reports Qwen3.6-35B-A3B at 12.48 t/s generation and 222 t/s prefill on a single RTX 3070 Laptop 8GB with 32GB system RAM.
Setup is Krasis runtime with HQQ4 quantization and k4v4 KV cache, streaming the model from system RAM through VRAM.
Figures are best throughput obtained during the benchmark, not averages. The post also lists results for RTX 5080, RTX A4500, and RTX 5090.