llamaperf

Qwen3.8 27B

on 2× NVIDIA V100 16GB · PXA · 15,000 ctx

Tone: positiveNVIDIA hardware
Sep 21, 2026
Throughput
68.6 t/s gen
Quant
PXQ4 (PXQ)

Summary

User reports Qwen3.8 27B at 68.6 t/s on 2× V100 16GB with the PXA engine's new tensor split, up from 51.0 t/s with the layer split it replaces. Setup is PXA v2026.09.20 with the PXQ4 quant format on PCIe x4 risers; the same run hit 107.4 t/s on repetitive text and 43.6 t/s on a ~15k-token prompt. A head-to-head against stock llama.cpp on the same cards gives 80.2 vs 58.9 t/s on prose, 139.8 vs 80.5 on repetitive text, and 47.8 vs 46.1 on the ~15k-token prompt. The user notes the long-context row is a narrow win and that prompt processing under the tensor split is slower than their own layer split on x4 risers (850 vs 1,020 t/s).