Qwen3.5 9B
2× AMD FirePro D700 6GB · llama.cpp · 70,000 ctx
- generation:
- 11.0 tokens/s
- quant:
- Q4 (GGUF)
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is shown only when the source reports it; generation speed cannot tell us time to first token. Check the full setup before comparing.
coding
User reports Qwen 3.5 9B Q4 with MTP at 11 t/s output at 70k context on a pair of AMD FirePro D700 GPUs in an old Mac Pro. Setup is llama.cpp on Vulkan across the two D700s with 12gb of VRAM, in a machine with 64gb of RAM. Qwen 2.5 coder q4 runs at 22 t/s output at 70k context on the same machine. The user finds Qwen 3.5's planning output significantly better than Claude Sonnet 4.6 on a complex C# .NET 10 app.