llamaperf
Oct 9, 2026
Throughput
49.7 t/s gen
Quant
Q8 (GGUF)
System RAM
128 GB

Use cases

codingagentic

Summary

User reports Qwen 3.5 35B at 49.7 tok/s on a Strix Halo 128GB machine. Setup is llama.cpp via llama-swap with a HuggingFace GGUF Q8 quant. The same model completed the coding benchmark under Ollama but produced off-spec output; under llama-swap it completed with a full Rails app. Other local models on the same machine: Qwen 3 Coder Next 72.9 tok/s, GPT OSS 20B 78.3 tok/s, Gemma 4 27B 47.6 tok/s, GLM 4.7 Flash 47.4 tok/s, Qwen 3.5 122B 23.1 tok/s, Llama 4 Scout 17.5 tok/s, Qwen 3 32B 11.7 tok/s.