llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 4090 · VEIZIK · 512 ctx

NVIDIA hardware
Nov 20, 2026
Throughput
272.5 t/s gen
VRAM reported
24 GB

Summary

User reports Qwen3.6-35B-A3B at 272.5 tok/s on a single RTX 4090 using their own VEIZIK runtime. Setup is VEIZIK with an approximately 4-bit-class quant at a 512-token context, single stream, with 21.4 GiB of GPU memory resident. llama.cpp with Q4_K_M on the same pod measured 184.5 tok/s; the user notes slightly higher KL divergence for VEIZIK.