Qwen3.5 9B
on 2× AMD FirePro D700 6GB · llama.cpp · 70,000 ctx
Use cases
coding
Summary
User reports Qwen 3.5 9B Q4 with MTP at 11 t/s output at 70k context on a pair of AMD FirePro D700 GPUs in an old Mac Pro.
Setup is llama.cpp on Vulkan across the two D700s with 12gb of VRAM, in a machine with 64gb of RAM.
Qwen 2.5 coder q4 runs at 22 t/s output at 70k context on the same machine. The user finds Qwen 3.5's planning output significantly better than Claude Sonnet 4.6 on a complex C# .NET 10 app.