llamaperf

Ornith1.5 35B (3B active)

on 2× NVIDIA RTX 5070 Ti · Ollama · 131,072 ctx

Tone: positiveNVIDIA hardware
Oct 5, 2026
Throughput
180.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
64 GB

Use cases

agenticcodingtool-uselong-context

Summary

User reports Ornith 1.5 35B-A3B at about 180 tok/s on two RTX 5070 Ti 16GB cards, roughly 3x the 55-70 tok/s of the Qwen3.8 27B it replaced. Setup is Ollama on Windows with Q4_K_M at 128K context, 24.4GB fully on the two cards; the agent runs on pi in WSL. Two runs gave 176 and 183 tok/s with a short prompt and thinking off. At 256K about 1.2GB spills to system RAM and speed drops to about 139 tok/s, so 128K stays the default. Both of the user's agent tests max out at 9/9 and 10/10, which the user notes only shows it is not worse than the 27B, not that it is smarter. Vendor numbers of 79 on SWE-bench Verified and 68.5 on Terminal-Bench 2.1 are cited but untested.