Qwen3.5 9B
on NVIDIA RTX 3080 Ti · llama.cpp
Summary
User reports Qwen 3.5 9B at about 100 t/s on an RTX 3080 Ti, matching figures others have posted.
Setup is llama.cpp with Q4_K_M weights, run at a 260W power limit instead of the stock 400W.
Reducing the limit from 450W to 260W showed no meaningful drop in tok/s; at 220W the rate fell to about 80 t/s. The user notes VRAM bandwidth never maxes out and wonders whether another bottleneck is at play.