Qwen3.8 27B
on 2× NVIDIA V100 16GB · PXA · 15,000 ctx
Summary
User reports Qwen3.8 27B at 68.6 t/s on 2× V100 16GB with the PXA engine's new tensor split, up from 51.0 t/s with the layer split it replaces.
Setup is PXA v2026.09.20 with the PXQ4 quant format on PCIe x4 risers; the same run hit 107.4 t/s on repetitive text and 43.6 t/s on a ~15k-token prompt.
A head-to-head against stock llama.cpp on the same cards gives 80.2 vs 58.9 t/s on prose, 139.8 vs 80.5 on repetitive text, and 47.8 vs 46.1 on the ~15k-token prompt. The user notes the long-context row is a narrow win and that prompt processing under the tensor split is slower than their own layer split on x4 risers (850 vs 1,020 t/s).