Qwen3.5 35B (3B active)
on NVIDIA RTX 5090 · llama.cpp
Sep 25, 2026
Summary
User compares Qwen3.5-35B-A3B Q4_K_XL on an RTX 5090 against a Radeon AI PRO R9700, both 32 GB, using llama-bench with -ngl 99, flash attention and q8_0 KV cache.
On the RTX 5090 generation is 194.0 t/s and prompt processing is 7,026 t/s at 512 tokens, 6,953 at 1,024, 6,958 at 4,096 and 6,461 at 32,768.
The R9700 reaches 127.4 t/s generation and 2,713 / 2,643 / 2,546 / 1,877 t/s prompt processing at the same context lengths, a 1.52x generation and up to 3.44x prefill gap. The user notes these are single-stream llama-bench figures and calls the R9700 comfortable for interactive use at roughly 2.66x lower cost.