Ornith1.5 35B (3B active)
on RTX 2050 4GB
Use cases
coding
Summary
User reports Ornith 1.5 35B at around 9.4 t/s on an RTX 2050 4GB laptop with 16GB RAM, streaming the model mostly from SSD with a custom inference engine.
For reference, GPT-OSS 20B gets around 6 t/s using GPU+CPU in LM Studio on the same machine.
User asks for pruned or distilled MoE models or Q4 quants under 80GB for web development.