Qwen3.8 27B
on 2× NVIDIA V100 16GB · PXA · 4,096 ctx
Summary
User reports Qwen3.8-27B at 96.7 t/s decode on two V100s with PXA v3.
Setup is PXA engine with PXQN2 quant, 4,096-token prompt, speculative decoding on.
Same model runs 85.8 t/s on one V100, 60.1 t/s on two P100s and 48.1 t/s on one P100. Gemma 4 26B-A4B reaches 168.6 t/s on one V100 and 71.1 t/s on one P100. A Flash-Next MoE runs 36.3 t/s on four P100s and 20.4 t/s on one P100 with system RAM.