llamaperf
Sep 27, 2026
Throughput
9.4 t/s gen
System RAM
16 GB
VRAM reported
4 GB

Use cases

coding

Summary

User reports Ornith 1.5 35B at around 9.4 t/s on an RTX 2050 4GB laptop with 16GB RAM, streaming the model mostly from SSD with a custom inference engine. For reference, GPT-OSS 20B gets around 6 t/s using GPU+CPU in LM Studio on the same machine. User asks for pruned or distilled MoE models or Q4 quants under 80GB for web development.