Qwen3.8 27B
on 2× NVIDIA RTX PRO 5000 Blackwell (one 72GB card and one 48GB card) · llama.cpp
Summary
User reports Qwen3.8-27B at 62.3 t/s generation and 3002.5 t/s prompt processing on one RTX PRO 5000 Blackwell 72 GB plus one RTX PRO 5000 Blackwell 48 GB.
Setup is llama.cpp CUDA b10941 with Q8_0, f16 K/V cache, flash attention on, tensor split 1/1, -ngl 999, batch 2048 and microbatch 512.
The 62.3 t/s is TG128 and the 3002.5 t/s is PP512, separate tests, each the mean of five repetitions; the author reports TG reproducibility around 1% and PP drift up to about 10% between sessions.