llamaperf

Qwen3.6 35B (3B active)

on 3× NVIDIA RTX Pro 6000 Blackwell · NInfer

Tone: positiveNVIDIA hardware
Oct 17, 2026
Throughput
500.0 t/s gen
System RAM
128 GB

Use cases

agentictool-uselong-context

Summary

User reports Qwen 3.6 35B-A3B at 500 tok/s decode on a machine with an RTX Pro 6000 and 2x RTX 3090 (96GB + 24GB + 24GB VRAM) and 128GB system RAM. Setup is NInfer; quant and context length are not stated. The 500 tok/s figure is for fast, simple tasks; the user's main agentic driver is Qwen Flash Next at Q6, with DSv4F+vision at Q8 as a tossup. Qwen 3.8 27B was the previous driver but struggles on long autonomous runs with 250+ tool uses per turn.