Qwen3.6 35B (3B active)
on NVIDIA RTX 4090 · VEIZIK · 512 ctx
Summary
User reports Qwen3.6-35B-A3B at 272.5 tok/s on a single RTX 4090 using their own VEIZIK runtime.
Setup is VEIZIK with an approximately 4-bit-class quant at a 512-token context, single stream, with 21.4 GiB of GPU memory resident.
llama.cpp with Q4_K_M on the same pod measured 184.5 tok/s; the user notes slightly higher KL divergence for VEIZIK.