Qwen3.8 27B
on 2× NVIDIA V100 16GB · NInfer
Summary
User reports Qwen3.8 27B at 180 t/s on a pair of V100 16GB cards without NVLink.
Setup uses NInfer with NVFP4 weights, Q8 KV cache and MTP 4/0 speculative decoding.
The user calls it the legend of V100 and links the tuxKOH/ninfer-V100X2 repo.