Qwen3.5 0.8B

User benchmarks SGLang 0.5.17, vLLM 0.26.0 and llama.cpp b10333 on a 128GB GMKtec EVO-X3 with Ryzen AI MAX+ 395 / Radeon 8060S (gfx1151). On Qwen3.5-0.8B BF16, custom vLLM reached 86.59 tok/s at one client and 311.59 tok/s aggregate at eight clients, beating SGLang and llama.cpp at every concurrency. Setup used ROCm 7.14, 4096-token API limit, deterministic 598-638 token prompts with 64 output tokens, prefix caching disabled. vLLM won all 20 matched concurrency points against SGLang across Qwen3.5-0.8B, Qwen3-8B, Qwen3-Coder-30B-A3B and a shared-prefix workload. For Qwen3.5-122B-A10B, custom llama.cpp with UD-Q4_K_XL reached 13.57 tok/s at one client and official llama.cpp 17.88 tok/s aggregate at two clients. DeepSeek V4 Flash on a specialised Lucebox ROCmFP3 service reached 23.70 tok/s median.