llamaperf

Qwen3.6 35B (3B active)

on NVIDIA V100 16GB · PXA

Tone: positiveNVIDIA hardware
Oct 30, 2026
Throughput
82-89 t/s gen
VRAM reported
16 GB

Summary

User reports Qwen3.6-35B-A3B decoding at 82 to 89 t/s on one V100 16GB with their PXA 4.0 engine, a fork of llama.cpp. Setup is PXA 4.0 with greedy decoding, three or six repetitions, compared against mainline llama.cpp on the same box and quant class file. The figure is a range; the post claims 2.3x to 2.5x over mainline llama.cpp and 1.3x to 1.45x over PXA 3.1. Other rows cover Nemotron-3-Nano-30B-A3B at 106 to 115 t/s on one V100, Nemotron-3.5-Super-VL-120B-A12B at 24 to 26 t/s on two P100s, Nemotron-3.5-Bolt-74B-A9B at 44 to 45 t/s on two P100s, GLM-5.3-Flash at 9 to 10 t/s on two V100s, Qwen3.8-27B at 42 to 97 t/s on one V100, and Gemma-4-26B-A4B at 123 to 128 t/s decode and 2,400 to 4,400 t/s prompt processing on one V100. Qwen3.8 Flash-Next prompt processing with experts in system RAM reaches 550 to 660 t/s on one V100. The author notes the 97 t/s dense 27B figure is the code class with MTP drafting, prose lands in the 40s to 60s on one V100, and big MoE decoding on one V100 with experts in system RAM is not yet published.