llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 4070 · PolyStrata

NVIDIA hardware
Oct 11, 2026
Throughput
73-75 t/s gen
Quant
UD-Q3_K_M (GGUF)
System RAM
32 GB
VRAM reported
8 GB

Summary

User reports Qwen3.6-35B-A3B at 73-75 tok/s generation and 1,390 tok/s prompt processing on a laptop with an RTX 4070 8 GB, i7-14700HX and 32 GB RAM. Setup is PolyStrata with UD-Q3_K_M GGUF, a 30,000-token prompt, CPU offload of experts and speculative decoding. The same model on an RTX 5090 32 GB writes 332-334 tok/s and reads 5,520-5,580. Gemma 4 26B-A4B, Ornith 1.5 and GLM 5.3 Flash were also measured on both machines; GLM 5.3 Flash does not fit in 32 GB of RAM.