Qwen3.8 27B

User reports Qwen3.8-27B NVFP4 at 143.5 committed output tok/s on two Tesla V100-SXM2 16GB cards with an 85,000-token coding input. Setup is NInfer-V100X2 with NVFP4 weights, INT8 group-64 KV cache, MTP4, 180,000-token context capacity, PCIe P2P and no NVLink. Prefill averaged about 1,310 tok/s over the 85K input, with peaks around 2,500 tok/s possible under PP2 pipeline parallelism. Short structured JSONL generation with DFlash7 reached 253+ tok/s, averaging 255.3 tok/s over the final two runs with 118 input tokens and 99.05% draft acceptance. The 143 tok/s route uses an experimental attention implementation that can change outputs and is off by default; on 104 GPQA-Diamond questions with 85K padding it scored 90/104 versus 88/104 for default attention.