Ornith1.5 35B (3B active)
on Unknown GPU · llama.cpp · 100,000 ctx
Use cases
coding
Summary
User reports Ornith1.5 35B-A3B at 24 t/s on a laptop with 6GB VRAM.
Setup is llama.cpp with the Q4_K_M GGUF, a q8_0 KV cache, and 100,000 context. Throughput drops to 7 t/s when the GPU reaches 87-88C and throttles, or when context usage reaches about 70%.
The model was used to generate a playable browser game from a single prompt, with minor manual fixes.