llamaperf

Qwen3.8 27B

on 2× 2x Tesla M10

Tone: negative
Nov 20, 2026
Throughput
1.3 t/s gen
Quant
Q4

Use cases

summarizationtool-use

Summary

User reports Qwen3.8 27B at 1.3 t/s on 2x Tesla M10s, running a Q4 quant for a shift-report dashboard with multi-turn follow-ups. No engine, context length or KV cache is stated. The user finds the speed too slow for the CEO to use interactively and is asking whether 4x P6000s or 2x RTX 5060 Ti 16GB would be better.