llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 3050 6GB · 65,536 ctx

Tone: mixedNVIDIA hardware
Oct 9, 2026
Throughput
30.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
24 GB
VRAM reported
6 GB

Use cases

agentic

Summary

User reports Qwen3.6 35B-A3B at 30 t/s on an RTX 3050 6GB with 24GB system RAM, dropping to around 22 t/s once the 64K context is full. Setup uses the Unsloth Q4_K_M quant with 64K context; the model is partially offloaded to system RAM. User is building a voice agent with Moonshine Small and Faster-Whisper STT/TTS and asks for better voice model combinations and a faster alternative to Qwen3.6 MoE.