llamaperf

Ornith1.5 35B (3B active)

on Intel Arc Pro B70 · GRIMOIRE

Intel hardware
Oct 4, 2026
Throughput
175.3 t/s gen · 9698.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
MXFP4 (MXFP4)

Summary

User reports Ornith-1.5-35B-A3B at 175.25 tok/s generation and 9,698.55 tok/s prompt processing at concurrency 1 on an Intel Arc Pro B70. Setup is GRIMOIRE, a native C++/SYCL inference engine, with MXFP4 weights and 4096-token prompts. At concurrency 8 the engine reaches 391.04 tok/s total generation and 10,154.18 tok/s total prompt processing. A separate v1.5 build measured 193.6 tok/s at c1 and 464.2 tok/s total at c8, with pp512 at c8 measuring 9,547 tok/s.