llamaperf

Qwen3 235B (22B active)

on NVIDIA RTX 3090 · text-generation-webui · 16,384 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
7.5 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
128 GB
VRAM reported
24 GB

Summary

User reports Qwen3-235B-A22B at about 7.5 t/s generation and about 75k pp on a single RTX 3090 with 128 GB of system RAM. Setup is textgen with batch size 1024, 16384 context, autofit layers, and 38 of 48 threads on a dual Xeon DDR4 system. Generation dips to about 7 t/s at 10k context. The user calls it a daily driver for months for uncensored ERP roleplay, and mentions Step 3.7 Flash as an alternative that is censored and verbose, along with Gemma 4 and MiniMax-M2.5, which were not run.