Qwen3.6 35B (3B active)
on 2× NVIDIA RTX PRO 5000 Blackwell (one 72GB card and one 48GB card) · llama.cpp
Summary
User reports Qwen3.6-35B-A3B at 208.7 t/s generation and 7492.8 t/s prompt processing on one RTX PRO 5000 Blackwell 72 GB plus one RTX PRO 5000 Blackwell 48 GB.
Setup is llama.cpp CUDA b10941 with Q8_0, f16 K/V cache, flash attention on, batch 2048, microbatch 512, and tensor 1/1 split across the two cards.
The 208.7 t/s is TG128 and the 7492.8 t/s is PP512, separate tests, each the mean of five repetitions; the author reports TG reproducibility around 1% and PP drift up to about 10% between sessions.