Ornith1.5 35B (3B active)
on Intel Arc Pro B70 · GRIMOIRE
Summary
User reports Ornith-1.5-35B-A3B at 175.25 tok/s generation and 9,698.55 tok/s prompt processing at concurrency 1 on an Intel Arc Pro B70.
Setup is GRIMOIRE, a native C++/SYCL inference engine, with MXFP4 weights and 4096-token prompts.
At concurrency 8 the engine reaches 391.04 tok/s total generation and 10,154.18 tok/s total prompt processing. A separate v1.5 build measured 193.6 tok/s at c1 and 464.2 tok/s total at c8, with pp512 at c8 measuring 9,547 tok/s.