Qwen3.6 27B
on 2× V100
Summary
User reports Qwen3.6 27B at around 80t/s generation and 3000 t/s prompt processing for a single user on V100s.
Setup is batch 1 with no MTP, on a multi-card V100 setup whose card count the source does not give.
At 128 concurrent requests the same setup reaches 1000 tps generation, which the user says is far removed from what they need.