llamaperf
Oct 11, 2026
Throughput
50.0 t/s gen · 500-900 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
128 GB

Use cases

agenticcodingtool-use

Summary

User asks how to combine a 128GB Evo-X2, a 48GB MacBook Pro M5 Pro and an RTX 4080 Super desktop for local LLM work. The Evo-X2 runs a Qwen 35B MoE at about 500-900 tok/s prompt processing and roughly 50 tok/s decode, used for business products rather than as a daily driver. The user also describes a memory layer and an orchestrator setup with leads and an oracle, and asks whether they are reinventing the wheel.