llamaperf

Qwen3.5 122B (10B active) Opus-Reasoning

on 2× AMD Strix Halo 128GB · llama.cpp · 32,768 ctx

Tone: positiveAMD hardware
Sep 7, 2026
Throughput
49.0 t/s gen · 682.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
System RAM
128 GB
VRAM reported
160 GB

Summary

User reports a hybrid setup with Strix Halo 128GB and an R9700 32GB over x4 PCIe. Dense layers, KV cache, and the MTP drafter run on the R9700, while routed experts run on the Strix, using a custom llama.cpp fork. The user compares this to stock at 24 tok/s.